piflow_filter
Data processing · FilteringFilter Arrow batches by a SQLite SQL predicate (not Spark SQL). Params: condition, e.g. quality = 0 AND temperature >= 12. Scalar columns only.
Use this operator
operator: piflow_filter@1.2Configure remote_operator_library_urls with this repository’s origin. XStream verifies and caches artifacts by digest, sharing them across operators.
Named ports
- sourceInputrecords
Input records to process.
Formats: Any compatible format - resultOutputrecords
Keep records that satisfy the configured SQLite predicate.
Output structure and samples are provided by operator inference.
Parameters
- conditionstringRequired
SQLite SQL predicate applied to each record batch, e.g. quality = 0.
- How to fill
- Use column names from the input; quote string literals and CAST string columns for numeric comparisons.
- Example value
- quality = '0'
Operator usage example
Connect the input ports to upstream steps and adjust the parameters for your data.
id: process
operator: piflow_filter@1.2
inputs:
source: read_source
params:
condition: quality = '0'
Manual download
curl -fLo 'operator.zip' 'https://repo.conox.cn/v1/blobs/sha256/fe3b1fdb9d9fa4f6b917eca8d0211bae801f59133923413a9073642266319b99/operator.zip'
sha256sum -- 'operator.zip'
curl -fLo 'environment.tar' 'https://repo.conox.cn/v1/blobs/sha256/e086e3ee88de7f8dba45ca317a0332ced7b55fec45fc8bb43a5934dac7c3204d/environment.tar'
sha256sum -- 'environment.tar'Compare checksums with the manifest. Download execution and build environments from the runtime catalog ↗.
Source and licensing
See Source archive under Artifact details
- Source repository
- Source repository not provided
- Source revision
- Revision not declared
- License (publisher declared)
- Apache-2.0
- License text
- License text not provided
- Dependency SBOM
- Dependency SBOM not provided
Build instructions
Build instructions not provided
Publisher-provided source, licenses and dependency information support your review. Availability and checksums do not certify safety, legal clearance, or that the executable matches the source.