piflow_wild_spot_culling_mdv_i
PiFlow · Data processingEcoFlow outlier removal in fixed windows ceiling(id/mdv_num). Requires id. Params fields (one column),mdv_num positive string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream ignored statistic.
Use this operator
operator: piflow_wild_spot_culling_mdv_i@1.0Configure remote_operator_library_urls with this repository’s origin. XStream verifies and caches artifacts by digest, sharing them across operators.
Named ports
- sourceInputrecords
Name and type of the source stream: records. The accompanying fixture contains id, value.
Formats: Any compatible format - resultOutputrecords
Records result. EcoFlow outlier removal in fixed windows ceiling(id/mdv_num). Requires id. Params fields (one column),mdv_num positive string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream ignored statistic.
Output structure and samples are provided by operator inference.
Parameters
- fieldsstringRequired
fields parameter. EcoFlow outlier removal in fixed windows ceiling(id/mdv_num). Requires id. Params fields (one column),mdv_num positive string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream ignored statistic.
- How to fill
- fields parameter. EcoFlow outlier removal in fixed windows ceiling(id/mdv_num). Requires id. Params fields (one column),mdv_num positive string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream ignored statistic.
- Example value
- value
- mdv_numstringRequired
mdv_num parameter. EcoFlow outlier removal in fixed windows ceiling(id/mdv_num). Requires id. Params fields (one column),mdv_num positive string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream ignored statistic.
- How to fill
- mdv_num parameter. EcoFlow outlier removal in fixed windows ceiling(id/mdv_num). Requires id. Params fields (one column),mdv_num positive string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream ignored statistic.
- Example value
- 5
- multiplestringRequired
multiple parameter. EcoFlow outlier removal in fixed windows ceiling(id/mdv_num). Requires id. Params fields (one column),mdv_num positive string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream ignored statistic.
- How to fill
- multiple parameter. EcoFlow outlier removal in fixed windows ceiling(id/mdv_num). Requires id. Params fields (one column),mdv_num positive string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream ignored statistic.
- Example value
- 1
- statisticalTypestringRequired
statisticalType parameter. EcoFlow outlier removal in fixed windows ceiling(id/mdv_num). Requires id. Params fields (one column),mdv_num positive string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream ignored statistic.
- How to fill
- statisticalType parameter. EcoFlow outlier removal in fixed windows ceiling(id/mdv_num). Requires id. Params fields (one column),mdv_num positive string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream ignored statistic.
- Example value
- stddev
- flagValuestringRequired
flagValue parameter. EcoFlow outlier removal in fixed windows ceiling(id/mdv_num). Requires id. Params fields (one column),mdv_num positive string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream ignored statistic.
- How to fill
- flagValue parameter. EcoFlow outlier removal in fixed windows ceiling(id/mdv_num). Requires id. Params fields (one column),mdv_num positive string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream ignored statistic.
- Example value
- -9999
Operator usage example
Connect the input ports to upstream steps and adjust the parameters for your data.
id: process
operator: piflow_wild_spot_culling_mdv_i@1.0
inputs:
source: read_source
params:
fields: value
mdv_num: '5'
multiple: '1'
statisticalType: stddev
flagValue: '-9999'
Manual download
curl -fLo 'operator.jar' 'https://repo.conox.cn/v1/blobs/sha256/e75b8d902dab4227c44f2b0de9d0125f0a91cfc8a5505a974608a06e97f3b204/operator.jar'
sha256sum -- 'operator.jar'
curl -fLo 'LICENSE.txt' 'https://repo.conox.cn/v1/blobs/sha256/c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4/LICENSE.txt'
sha256sum -- 'LICENSE.txt'Compare checksums with the manifest. Download execution and build environments from the runtime catalog ↗.
Source and licensing
See Source archive under Artifact details
- Source repository
- https://github.com/cas-bigdatalab/piflow
- Source revision
- 84de10436a0d382e0d8d2ce1ab3a82f71ebafc29
- License (publisher declared)
- Apache-2.0
- License text
- Available below
- Dependency SBOM
- Dependency SBOM not provided
Build instructions
Compile the adapter under src/ using the registered piflow-ecoflow-spark builder. See spec.json and the upstream source manifest.
Publisher-provided source, licenses and dependency information support your review. Availability and checksums do not certify safety, legal clearance, or that the executable matches the source.