OPERATOR / VERSION 1.0

piflow_filter

Data processing · Filtering

Filter Arrow batches by a SQLite SQL predicate (not Spark SQL). Params: condition, e.g. quality = 0 AND temperature >= 12. Scalar columns only.

View manifest JSON ↗

Use this operator

operator: piflow_filter@1.0

Configure remote_operator_library_urls with this repository’s origin. XStream verifies and caches artifacts by digest, sharing them across operators.

Named ports

  • sourceInputrecords

    Input records to process.

    Formats: Any compatible format
  • resultOutputrecords

    Keep records that satisfy the configured SQLite predicate.

Output structure and samples are provided by operator inference.

Parameters

  • conditionstringRequired

    SQLite SQL predicate applied to each record batch, e.g. quality = 0.

    How to fill
    Use column names from the input; quote string literals and CAST string columns for numeric comparisons.
    Example value
    quality = '0'

Operator usage example

Connect the input ports to upstream steps and adjust the parameters for your data.

id: process
operator: piflow_filter@1.0
inputs:
  source: read_source
params:
  condition: quality = '0'

Manual download

curl -fLo 'operator.zip' 'https://repo.conox.cn/v1/blobs/sha256/af11f9940366a7dfe1b4fface4fbb7fc7085968b39ba959739214e2a3b36b720/operator.zip'
sha256sum -- 'operator.zip'

Compare checksums with the manifest. Download execution and build environments from the runtime catalog ↗.

Source and licensing

See Source archive under Artifact details

Source repository
Source repository not provided
Source revision
Revision not declared
License (publisher declared)
Apache-2.0
License text
License text not provided
Dependency SBOM
Dependency SBOM not provided

Build instructions

Build instructions not provided

Publisher-provided source, licenses and dependency information support your review. Availability and checksums do not certify safety, legal clearance, or that the executable matches the source.