OPERATOR / VERSION 1.0

piflow_field_type_conversion

PiFlow · Data conversion

Cast selected fields to double precision, 32-bit integer or fixed-precision decimal. Preserve other columns.

View manifest JSON ↗

Use this operator

operator: piflow_field_type_conversion@1.0

Configure remote_operator_library_urls with this repository’s origin. XStream verifies and caches artifacts by digest, sharing them across operators.

Named ports

  • sourceInputrecords

    Arrow records. The example uses measurement, count, price, station.

    Formats: Any compatible format
  • resultOutputrecords

    Records stream. Cast selected fields to double precision, 32-bit integer or fixed-precision decimal. Preserve other columns.

Output structure and samples are provided by operator inference.

Parameters

  • doubleTypeFieldstringRequired

    Comma-separated names to cast to double, or empty to skip.

    How to fill
    Comma-separated names to cast to double, or empty to skip.
    Example value
    measurement
  • intTypeFieldstringRequired

    Comma-separated names to cast to a 32-bit integer, or empty to skip.

    How to fill
    Comma-separated names to cast to a 32-bit integer, or empty to skip.
    Example value
    count
  • decimalTypeFieldstringRequired

    Comma-separated names to cast to fixed-precision decimal, or empty to skip.

    How to fill
    Comma-separated names to cast to fixed-precision decimal, or empty to skip.
    Example value
    price
  • decimalTypePrecisionstringRequired

    Decimal precision and scale with precision from 1 to 38.

    How to fill
    Decimal precision and scale with precision from 1 to 38.
    Example value
    DECIMAL(12, 2)

Operator usage example

Connect the input ports to upstream steps and adjust the parameters for your data.

id: process
operator: piflow_field_type_conversion@1.0
inputs:
  source: read_source
params:
  doubleTypeField: measurement
  intTypeField: count
  decimalTypeField: price
  decimalTypePrecision: DECIMAL(12, 2)

Manual download

curl -fLo 'operator.zip' 'https://repo.conox.cn/v1/blobs/sha256/e3ddd9928ecadc611b7d2724de882d9d57e39a5bdb815cb83c7e4c77c610be4f/operator.zip'
sha256sum -- 'operator.zip'
curl -fLo 'LICENSE.txt' 'https://repo.conox.cn/v1/blobs/sha256/c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4/LICENSE.txt'
sha256sum -- 'LICENSE.txt'

Compare checksums with the manifest. Download execution and build environments from the runtime catalog ↗.

Source and licensing

See Source archive under Artifact details

Source repository
https://github.com/cas-bigdatalab/piflow
Source revision
db177aa6d9b84d91078caa9a591574b1fe3cf20c
License (publisher declared)
Apache-2.0
License text
Available below
Dependency SBOM
Dependency SBOM not provided

Build instructions

Build the Python SDK adapter in src/ with python-arrow@2.0. See job.yaml for an example using the supplied fixtures.

Publisher-provided source, licenses and dependency information support your review. Availability and checksums do not certify safety, legal clearance, or that the executable matches the source.