piflow_discretization
PiFlow · StatisticsAssign zero-based numeric bins using upstream equal-width unit cuts or exact equal-frequency quantiles.
Use this operator
operator: piflow_discretization@1.0Configure remote_operator_library_urls with this repository’s origin. XStream verifies and caches artifacts by digest, sharing them across operators.
Named ports
- sourceInputrecords
Arrow records. The example uses value.
Formats: Any compatible format - resultOutputrecords
Records stream. Assign zero-based numeric bins using upstream equal-width unit cuts or exact equal-frequency quantiles.
Output structure and samples are provided by operator inference.
Parameters
- inputColstringRequired
Name of the numeric input column.
- How to fill
- Name of the numeric input column. · Minimum length: 1
- Example value
- value
- outputColstringRequired
Name of the numeric result column.
- How to fill
- Name of the numeric result column. · Minimum length: 1
- Example value
- scaled
- numBinsintegerRequired
Number of buckets from 2 to 1,000.
- How to fill
- Number of buckets from 2 to 1,000. · Minimum: 2 · Maximum: 1000
- Example value
- 2
- methodstringRequired
EqualWidth uses unit cuts and accepts values from zero through numBins. EqualFrequency uses observed quantiles.
- How to fill
- EqualWidth uses unit cuts and accepts values from zero through numBins. EqualFrequency uses observed quantiles. · Allowed values: EqualWidth, EqualFrequency
- Example value
- EqualWidth
Operator usage example
Connect the input ports to upstream steps and adjust the parameters for your data.
id: process
operator: piflow_discretization@1.0
inputs:
source: read
params:
inputCol: value
outputCol: scaled
numBins: 2
method: EqualWidth
Manual download
curl -fLo 'operator.zip' 'https://repo.conox.cn/v1/blobs/sha256/4ede36d7b9ded08da84f8293cbd8b0d8a5846ed03c57055196d401660007a49b/operator.zip'
sha256sum -- 'operator.zip'
curl -fLo 'LICENSE.txt' 'https://repo.conox.cn/v1/blobs/sha256/c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4/LICENSE.txt'
sha256sum -- 'LICENSE.txt'Compare checksums with the manifest. Download execution and build environments from the runtime catalog ↗.
Source and licensing
See Source archive under Artifact details
- Source repository
- https://github.com/cas-bigdatalab/piflow
- Source revision
- 777361c4e72b2c5457479683916b7c8e635289ff
- License (publisher declared)
- Apache-2.0
- License text
- Available below
- Dependency SBOM
- Dependency SBOM not provided
Build instructions
Build the Python SDK adapter in src/ with python-arrow@2.0. See job.yaml for an example using the supplied fixtures.
Publisher-provided source, licenses and dependency information support your review. Availability and checksums do not certify safety, legal clearance, or that the executable matches the source.