piflow_batch_field_threshold_clean
PiFlow · Data processingEcoFlow inclusive threshold cleaning. left: records to clean; right: field,min_value,max_value,flag_value threshold records. No params. Fixes upstream Row-to-string field matching; field names must match exactly. Spark may coerce affected column types.
Use this operator
operator: piflow_batch_field_threshold_clean@1.0Configure remote_operator_library_urls with this repository’s origin. XStream verifies and caches artifacts by digest, sharing them across operators.
Named ports
- leftInputrecords
Name and type of the left stream: records. The accompanying fixture contains temperature, quality.
Formats: Any compatible format - rightInputrecords
Name and type of the right stream: records. The accompanying fixture contains field, min_value, max_value, flag_value.
Formats: Any compatible format - resultOutputrecords
Records result. EcoFlow inclusive threshold cleaning. left: records to clean; right: field,min_value,max_value,flag_value threshold records. No params. Fixes upstream Row-to-string field matching; field names must match exactly. Spark may coerce affected column types.
Output structure and samples are provided by operator inference.
Parameters
No parameters required.
Operator usage example
Connect the input ports to upstream steps and adjust the parameters for your data.
id: process
operator: piflow_batch_field_threshold_clean@1.0
inputs:
left: read_left
right: read_right
params: {}
Manual download
curl -fLo 'operator.jar' 'https://repo.conox.cn/v1/blobs/sha256/2cb3d5bace30f795dc3cb642f27df34476c9c59b7a0f2e3bc387a08ee0b2a88b/operator.jar'
sha256sum -- 'operator.jar'
curl -fLo 'LICENSE.txt' 'https://repo.conox.cn/v1/blobs/sha256/c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4/LICENSE.txt'
sha256sum -- 'LICENSE.txt'Compare checksums with the manifest. Download execution and build environments from the runtime catalog ↗.
Source and licensing
See Source archive under Artifact details
- Source repository
- https://github.com/cas-bigdatalab/piflow
- Source revision
- 84de10436a0d382e0d8d2ce1ab3a82f71ebafc29
- License (publisher declared)
- Apache-2.0
- License text
- Available below
- Dependency SBOM
- Dependency SBOM not provided
Build instructions
Compile the adapter under src/ using the registered piflow-ecoflow-spark builder. See spec.json and the upstream source manifest.
Publisher-provided source, licenses and dependency information support your review. Availability and checksums do not certify safety, legal clearance, or that the executable matches the source.