OPERATOR / VERSION 1.0

piflow_column_check

PiFlow · Data processing

Validate full ordered column names against a reference and return left input. Params: none. Inputs: left, right. Left-input buffering limit: 128 MiB. Does not check physical units.

View manifest JSON ↗

Use this operator

operator: piflow_column_check@1.0

Configure remote_operator_library_urls with this repository’s origin. XStream verifies and caches artifacts by digest, sharing them across operators.

Named ports

  • leftInputrecords

    Name and type of the left stream: records. The accompanying fixture contains station_id, temperature, quality.

    Formats: Any compatible format
  • rightInputrecords

    Name and type of the right stream: records. The accompanying fixture contains station_id, temperature, quality.

    Formats: Any compatible format
  • resultOutputrecords

    Records result. Validate full ordered column names against a reference and return left input. Params: none. Inputs: left, right. Left-input buffering limit: 128 MiB. Does not check physical units.

Output structure and samples are provided by operator inference.

Parameters

No parameters required.

Operator usage example

Connect the input ports to upstream steps and adjust the parameters for your data.

id: process
operator: piflow_column_check@1.0
inputs:
  left: read_left
  right: read_right
params: {}

Manual download

curl -fLo 'operator.zip' 'https://repo.conox.cn/v1/blobs/sha256/85859601d4e68eafd0310107268fe3faf1691d94dd27e2522ea5fe8148aa111a/operator.zip'
sha256sum -- 'operator.zip'
curl -fLo 'LICENSE.txt' 'https://repo.conox.cn/v1/blobs/sha256/c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4/LICENSE.txt'
sha256sum -- 'LICENSE.txt'

Compare checksums with the manifest. Download execution and build environments from the runtime catalog ↗.

Source and licensing

See Source archive under Artifact details

Source repository
https://github.com/cas-bigdatalab/piflow
Source revision
84de10436a0d382e0d8d2ce1ab3a82f71ebafc29
License (publisher declared)
Apache-2.0
License text
Available below
Dependency SBOM
Dependency SBOM not provided

Build instructions

Compile the adapter under src/ using the registered python-arrow builder. See spec.json and the upstream source manifest.

Publisher-provided source, licenses and dependency information support your review. Availability and checksums do not certify safety, legal clearance, or that the executable matches the source.