OPERATOR / VERSION 1.0

piflow_province_clean

PiFlow · Data cleaning

Normalize common Chinese province names, suffixes and exact romanized names. Replace the selected string columns while preserving other fields.

View manifest JSON ↗

Use this operator

operator: piflow_province_clean@1.0

Configure remote_operator_library_urls with this repository’s origin. XStream verifies and caches artifacts by digest, sharing them across operators.

Named ports

  • sourceInputrecords

    Arrow records. The example uses value, id.

    Formats: Any compatible format
  • resultOutputrecords

    Records stream. Normalize common Chinese province names, suffixes and exact romanized names. Replace the selected string columns while preserving other fields.

Output structure and samples are provided by operator inference.

Parameters

  • columnNamestringRequired

    Comma-separated names of existing string columns.

    How to fill
    Comma-separated names of existing string columns. · Minimum length: 1
    Example value
    value

Operator usage example

Connect the input ports to upstream steps and adjust the parameters for your data.

id: process
operator: piflow_province_clean@1.0
inputs:
  source: read
params:
  columnName: value

Manual download

curl -fLo 'operator.zip' 'https://repo.conox.cn/v1/blobs/sha256/fdeb43c18f8e8ab0771b97c1955baed2388e4335eabd9304372e845ea354b446/operator.zip'
sha256sum -- 'operator.zip'
curl -fLo 'LICENSE.txt' 'https://repo.conox.cn/v1/blobs/sha256/c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4/LICENSE.txt'
sha256sum -- 'LICENSE.txt'

Compare checksums with the manifest. Download execution and build environments from the runtime catalog ↗.

Source and licensing

See Source archive under Artifact details

Source repository
https://github.com/cas-bigdatalab/piflow
Source revision
777361c4e72b2c5457479683916b7c8e635289ff
License (publisher declared)
Apache-2.0
License text
Available below
Dependency SBOM
Dependency SBOM not provided

Build instructions

Build the Python SDK adapter in src/ with python-arrow@2.0. See job.yaml for an example using the supplied fixtures.

Publisher-provided source, licenses and dependency information support your review. Availability and checksums do not certify safety, legal clearance, or that the executable matches the source.