OPERATOR / VERSION 1.0

piflow_person_id_expansion

PiFlow · Data cleaning

Split a document type and number pair into the corresponding identity field and append deterministic source identifiers.

View manifest JSON ↗

Use this operator

operator: piflow_person_id_expansion@1.0

Configure remote_operator_library_urls with this repository’s origin. XStream verifies and caches artifacts by digest, sharing them across operators.

Named ports

  • sourceInputrecords

    Arrow records. The example uses id_type, code, label.

    Formats: Any compatible format
  • resultOutputrecords

    Records stream. Split a document type and number pair into the corresponding identity field and append deterministic source identifiers.

Output structure and samples are provided by operator inference.

Parameters

  • expandIDFieldstringRequired

    Field containing the document number.

    How to fill
    Field containing the document number.
    Example value
    code
  • expandIDTypestringRequired

    Field holding the document type code, from 0 through 6.

    How to fill
    Field holding the document type code, from 0 through 6.
    Example value
    id_type
  • sourceLabelstringRequired

    Origin label used for the source column and deterministic UUID.

    How to fill
    Origin label used for the source column and deterministic UUID.
    Example value
    fixture

Operator usage example

Connect the input ports to upstream steps and adjust the parameters for your data.

id: process
operator: piflow_person_id_expansion@1.0
inputs:
  source: read_source
params:
  expandIDField: code
  expandIDType: id_type
  sourceLabel: fixture

Manual download

curl -fLo 'operator.zip' 'https://repo.conox.cn/v1/blobs/sha256/3e932ccb603a5e4b4bd70ea2460995b9dc84a4dd850efd89b6fd162af633de18/operator.zip'
sha256sum -- 'operator.zip'
curl -fLo 'LICENSE.txt' 'https://repo.conox.cn/v1/blobs/sha256/c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4/LICENSE.txt'
sha256sum -- 'LICENSE.txt'

Compare checksums with the manifest. Download execution and build environments from the runtime catalog ↗.

Source and licensing

See Source archive under Artifact details

Source repository
https://github.com/cas-bigdatalab/piflow
Source revision
f9bb5542e253fddea75a338a8dd476270f86ce59
License (publisher declared)
Apache-2.0
License text
Available below
Dependency SBOM
Dependency SBOM not provided

Build instructions

Build the Python SDK adapter in src/ with python-arrow@2.0. See job.yaml for an example using the supplied fixtures.

Publisher-provided source, licenses and dependency information support your review. Availability and checksums do not certify safety, legal clearance, or that the executable matches the source.