OPERATOR / VERSION 1.0

piflow_folder_csv_parser

PiFlow · CSV

Read CSV items from one folder. Skip a first row matching the configured schema and preserve field text.

View manifest JSON ↗

Use this operator

operator: piflow_folder_csv_parser@1.0

Configure remote_operator_library_urls with this repository’s origin. XStream verifies and caches artifacts by digest, sharing them across operators.

Named ports

  • sourceInputitems

    Items stream with file references. Matching Items are opened using their bytes view.

    Formats: Any compatible format
  • resultOutputrecords

    Records stream. Read CSV items from one folder. Skip a first row matching the configured schema and preserve field text.

Output structure and samples are provided by operator inference.

Parameters

  • schemastringRequired

    Comma-separated output column names.

    How to fill
    Comma-separated output column names.
    Example value
    id,name
  • delimiterstringRequired

    One-character CSV field delimiter.

    How to fill
    One-character CSV field delimiter. · Minimum length: 1 · Maximum length: 1
    Example value
    ,

Operator usage example

Connect the input ports to upstream steps and adjust the parameters for your data.

id: process
operator: piflow_folder_csv_parser@1.0
inputs:
  source: read_source
params:
  schema: id,name
  delimiter: ','

Manual download

curl -fLo 'operator.zip' 'https://repo.conox.cn/v1/blobs/sha256/bcf3480ad58a8fd6b03bb5a996e4984eb31d92d90ed1d5a1e663bc4a492f569d/operator.zip'
sha256sum -- 'operator.zip'
curl -fLo 'LICENSE.txt' 'https://repo.conox.cn/v1/blobs/sha256/2a45ff20671144c1709be48b36f5e55d97145c767dae1cf91965cbd2cf625768/LICENSE.txt'
sha256sum -- 'LICENSE.txt'

Compare checksums with the manifest. Download execution and build environments from the runtime catalog ↗.

Source and licensing

See Source archive under Artifact details

Source repository
https://github.com/cas-bigdatalab/piflow
Source revision
6f254537683a4af28c2b89ca5f5ad51fb71153dd
License (publisher declared)
Apache-2.0
License text
Available below
Dependency SBOM
Dependency SBOM not provided

Build instructions

Build the Python SDK adapter in src/ with python-arrow@2.1. See job.yaml for an example using the supplied fixtures.

Publisher-provided source, licenses and dependency information support your review. Availability and checksums do not certify safety, legal clearance, or that the executable matches the source.