OPERATOR / VERSION 1.0

piflow_discretization

PiFlow · Statistics

Assign zero-based numeric bins using upstream equal-width unit cuts or exact equal-frequency quantiles.

View manifest JSON ↗

Use this operator

operator: piflow_discretization@1.0

Configure remote_operator_library_urls with this repository’s origin. XStream verifies and caches artifacts by digest, sharing them across operators.

Named ports

  • sourceInputrecords

    Arrow records. The example uses value.

    Formats: Any compatible format
  • resultOutputrecords

    Records stream. Assign zero-based numeric bins using upstream equal-width unit cuts or exact equal-frequency quantiles.

Output structure and samples are provided by operator inference.

Parameters

  • inputColstringRequired

    Name of the numeric input column.

    How to fill
    Name of the numeric input column. · Minimum length: 1
    Example value
    value
  • outputColstringRequired

    Name of the numeric result column.

    How to fill
    Name of the numeric result column. · Minimum length: 1
    Example value
    scaled
  • numBinsintegerRequired

    Number of buckets from 2 to 1,000.

    How to fill
    Number of buckets from 2 to 1,000. · Minimum: 2 · Maximum: 1000
    Example value
    2
  • methodstringRequired

    EqualWidth uses unit cuts and accepts values from zero through numBins. EqualFrequency uses observed quantiles.

    How to fill
    EqualWidth uses unit cuts and accepts values from zero through numBins. EqualFrequency uses observed quantiles. · Allowed values: EqualWidth, EqualFrequency
    Example value
    EqualWidth

Operator usage example

Connect the input ports to upstream steps and adjust the parameters for your data.

id: process
operator: piflow_discretization@1.0
inputs:
  source: read
params:
  inputCol: value
  outputCol: scaled
  numBins: 2
  method: EqualWidth

Manual download

curl -fLo 'operator.zip' 'https://repo.conox.cn/v1/blobs/sha256/4ede36d7b9ded08da84f8293cbd8b0d8a5846ed03c57055196d401660007a49b/operator.zip'
sha256sum -- 'operator.zip'
curl -fLo 'LICENSE.txt' 'https://repo.conox.cn/v1/blobs/sha256/c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4/LICENSE.txt'
sha256sum -- 'LICENSE.txt'

Compare checksums with the manifest. Download execution and build environments from the runtime catalog ↗.

Source and licensing

See Source archive under Artifact details

Source repository
https://github.com/cas-bigdatalab/piflow
Source revision
777361c4e72b2c5457479683916b7c8e635289ff
License (publisher declared)
Apache-2.0
License text
Available below
Dependency SBOM
Dependency SBOM not provided

Build instructions

Build the Python SDK adapter in src/ with python-arrow@2.0. See job.yaml for an example using the supplied fixtures.

Publisher-provided source, licenses and dependency information support your review. Availability and checksums do not certify safety, legal clearance, or that the executable matches the source.