piflow_subtract
PiFlow · Data processingEXCEPT DISTINCT over whole rows: return unique left rows absent from right. Nulls compare equal for this set operation. No params. 128 MiB input limit each.
Use this operator
operator: piflow_subtract@1.0Configure remote_operator_library_urls with this repository’s origin. XStream verifies and caches artifacts by digest, sharing them across operators.
Named ports
- leftInputrecords
Name and type of the left stream: records. The accompanying fixture contains station_id, temperature, quality.
Formats: Any compatible format - rightInputrecords
Name and type of the right stream: records. The accompanying fixture contains station_id, temperature, quality.
Formats: Any compatible format - resultOutputrecords
Records result. EXCEPT DISTINCT over whole rows: return unique left rows absent from right. Nulls compare equal for this set operation. No params. 128 MiB input limit each.
Output structure and samples are provided by operator inference.
Parameters
No parameters required.
Operator usage example
Connect the input ports to upstream steps and adjust the parameters for your data.
id: process
operator: piflow_subtract@1.0
inputs:
left: read_left
right: read_right
params: {}
Manual download
curl -fLo 'operator.zip' 'https://repo.conox.cn/v1/blobs/sha256/82d54dbf844514c587e42de34d2509477bf20735c65d6b929132d0faef945b3a/operator.zip'
sha256sum -- 'operator.zip'
curl -fLo 'LICENSE.txt' 'https://repo.conox.cn/v1/blobs/sha256/c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4/LICENSE.txt'
sha256sum -- 'LICENSE.txt'Compare checksums with the manifest. Download execution and build environments from the runtime catalog ↗.
Source and licensing
See Source archive under Artifact details
- Source repository
- https://github.com/cas-bigdatalab/piflow
- Source revision
- 84de10436a0d382e0d8d2ce1ab3a82f71ebafc29
- License (publisher declared)
- Apache-2.0
- License text
- Available below
- Dependency SBOM
- Dependency SBOM not provided
Build instructions
Compile the adapter under src/ using the registered python-arrow builder. See spec.json and the upstream source manifest.
Publisher-provided source, licenses and dependency information support your review. Availability and checksums do not certify safety, legal clearance, or that the executable matches the source.