OPERATOR / VERSION 1.2

piflow_filter

Data processing · Filtering

Filter Arrow batches by a SQLite SQL predicate (not Spark SQL). Params: condition, e.g. quality = 0 AND temperature >= 12. Scalar columns only.

View manifest JSON ↗

Use this operator

operator: piflow_filter@1.2

Configure remote_operator_library_urls with this repository’s origin. XStream verifies and caches artifacts by digest, sharing them across operators.

Named ports

  • sourceInputrecords

    Input records to process.

    Formats: Any compatible format
  • resultOutputrecords

    Keep records that satisfy the configured SQLite predicate.

Output structure and samples are provided by operator inference.

Parameters

  • conditionstringRequired

    SQLite SQL predicate applied to each record batch, e.g. quality = 0.

    How to fill
    Use column names from the input; quote string literals and CAST string columns for numeric comparisons.
    Example value
    quality = '0'

Operator usage example

Connect the input ports to upstream steps and adjust the parameters for your data.

id: process
operator: piflow_filter@1.2
inputs:
  source: read_source
params:
  condition: quality = '0'

Manual download

curl -fLo 'operator.zip' 'https://repo.conox.cn/v1/blobs/sha256/fe3b1fdb9d9fa4f6b917eca8d0211bae801f59133923413a9073642266319b99/operator.zip'
sha256sum -- 'operator.zip'
curl -fLo 'environment.tar' 'https://repo.conox.cn/v1/blobs/sha256/e086e3ee88de7f8dba45ca317a0332ced7b55fec45fc8bb43a5934dac7c3204d/environment.tar'
sha256sum -- 'environment.tar'

Compare checksums with the manifest. Download execution and build environments from the runtime catalog ↗.

Source and licensing

See Source archive under Artifact details

Source repository
Source repository not provided
Source revision
Revision not declared
License (publisher declared)
Apache-2.0
License text
License text not provided
Dependency SBOM
Dependency SBOM not provided

Build instructions

Build instructions not provided

Publisher-provided source, licenses and dependency information support your review. Availability and checksums do not certify safety, legal clearance, or that the executable matches the source.