OPERATOR / VERSION 1.0

piflow_wild_spot_culling_mdv_g

PiFlow · Data processing

EcoFlow outlier removal from neighboring id windows, excluding current row. One field per step. Requires id; params fields,mdv_num positive odd string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream SQL syntax and undefined contrast_flag.

View manifest JSON ↗

Use this operator

operator: piflow_wild_spot_culling_mdv_g@1.0

Configure remote_operator_library_urls with this repository’s origin. XStream verifies and caches artifacts by digest, sharing them across operators.

Named ports

  • sourceInputrecords

    Name and type of the source stream: records. The accompanying fixture contains id, value.

    Formats: Any compatible format
  • resultOutputrecords

    Records result. EcoFlow outlier removal from neighboring id windows, excluding current row. One field per step. Requires id; params fields,mdv_num positive odd string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream SQL syntax and undefined contrast_flag.

Output structure and samples are provided by operator inference.

Parameters

  • fieldsstringRequired

    fields parameter. EcoFlow outlier removal from neighboring id windows, excluding current row. One field per step. Requires id; params fields,mdv_num positive odd string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream SQL syntax and undefined contrast_flag.

    How to fill
    fields parameter. EcoFlow outlier removal from neighboring id windows, excluding current row. One field per step. Requires id; params fields,mdv_num positive odd string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream SQL syntax and undefined contrast_flag.
    Example value
    value
  • mdv_numstringRequired

    mdv_num parameter. EcoFlow outlier removal from neighboring id windows, excluding current row. One field per step. Requires id; params fields,mdv_num positive odd string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream SQL syntax and undefined contrast_flag.

    How to fill
    mdv_num parameter. EcoFlow outlier removal from neighboring id windows, excluding current row. One field per step. Requires id; params fields,mdv_num positive odd string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream SQL syntax and undefined contrast_flag.
    Example value
    5
  • multiplestringRequired

    multiple parameter. EcoFlow outlier removal from neighboring id windows, excluding current row. One field per step. Requires id; params fields,mdv_num positive odd string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream SQL syntax and undefined contrast_flag.

    How to fill
    multiple parameter. EcoFlow outlier removal from neighboring id windows, excluding current row. One field per step. Requires id; params fields,mdv_num positive odd string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream SQL syntax and undefined contrast_flag.
    Example value
    2
  • statisticalTypestringRequired

    statisticalType parameter. EcoFlow outlier removal from neighboring id windows, excluding current row. One field per step. Requires id; params fields,mdv_num positive odd string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream SQL syntax and undefined contrast_flag.

    How to fill
    statisticalType parameter. EcoFlow outlier removal from neighboring id windows, excluding current row. One field per step. Requires id; params fields,mdv_num positive odd string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream SQL syntax and undefined contrast_flag.
    Example value
    stddev
  • flagValuestringRequired

    flagValue parameter. EcoFlow outlier removal from neighboring id windows, excluding current row. One field per step. Requires id; params fields,mdv_num positive odd string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream SQL syntax and undefined contrast_flag.

    How to fill
    flagValue parameter. EcoFlow outlier removal from neighboring id windows, excluding current row. One field per step. Requires id; params fields,mdv_num positive odd string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream SQL syntax and undefined contrast_flag.
    Example value
    -9999

Operator usage example

Connect the input ports to upstream steps and adjust the parameters for your data.

id: process
operator: piflow_wild_spot_culling_mdv_g@1.0
inputs:
  source: read_source
params:
  fields: value
  mdv_num: '5'
  multiple: '2'
  statisticalType: stddev
  flagValue: '-9999'

Manual download

curl -fLo 'operator.jar' 'https://repo.conox.cn/v1/blobs/sha256/984320279829f72bcee279d851ad0b82318df169ac3111ff5a3d9036e0266cf0/operator.jar'
sha256sum -- 'operator.jar'
curl -fLo 'LICENSE.txt' 'https://repo.conox.cn/v1/blobs/sha256/c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4/LICENSE.txt'
sha256sum -- 'LICENSE.txt'

Compare checksums with the manifest. Download execution and build environments from the runtime catalog ↗.

Source and licensing

See Source archive under Artifact details

Source repository
https://github.com/cas-bigdatalab/piflow
Source revision
84de10436a0d382e0d8d2ce1ab3a82f71ebafc29
License (publisher declared)
Apache-2.0
License text
Available below
Dependency SBOM
Dependency SBOM not provided

Build instructions

Compile the adapter under src/ using the registered piflow-ecoflow-spark builder. See spec.json and the upstream source manifest.

Publisher-provided source, licenses and dependency information support your review. Availability and checksums do not certify safety, legal clearance, or that the executable matches the source.