OPERATOR / VERSION 1.0

piflow_multi_folder_json_parser

PiFlow · JSON

Read JSON documents from two independently connected item collections and combine records by field name.

View manifest JSON ↗

Use this operator

operator: piflow_multi_folder_json_parser@1.0

Configure remote_operator_library_urls with this repository’s origin. XStream verifies and caches artifacts by digest, sharing them across operators.

Named ports

  • leftInputitems

    Items stream with file references. Matching Items are opened using their bytes view.

    Formats: Any compatible format
  • rightInputitems

    Items stream with file references. Matching Items are opened using their bytes view.

    Formats: Any compatible format
  • resultOutputrecords

    Records stream. Read JSON documents from two independently connected item collections and combine records by field name.

Output structure and samples are provided by operator inference.

Parameters

  • tagstringRequired

    Comma-separated fields to select. Use the empty string for all fields.

    How to fill
    Comma-separated fields to select. Use the empty string for all fields.
    Example value

Operator usage example

Connect the input ports to upstream steps and adjust the parameters for your data.

id: process
operator: piflow_multi_folder_json_parser@1.0
inputs:
  left: read_left
  right: read_right
params:
  tag: ''

Manual download

curl -fLo 'operator.zip' 'https://repo.conox.cn/v1/blobs/sha256/cd706b31ac745b5c73c35b77c020f3f210237db475a4079942246eeff0f33d00/operator.zip'
sha256sum -- 'operator.zip'
curl -fLo 'LICENSE.txt' 'https://repo.conox.cn/v1/blobs/sha256/2a45ff20671144c1709be48b36f5e55d97145c767dae1cf91965cbd2cf625768/LICENSE.txt'
sha256sum -- 'LICENSE.txt'

Compare checksums with the manifest. Download execution and build environments from the runtime catalog ↗.

Source and licensing

See Source archive under Artifact details

Source repository
https://github.com/cas-bigdatalab/piflow
Source revision
6f254537683a4af28c2b89ca5f5ad51fb71153dd
License (publisher declared)
Apache-2.0
License text
Available below
Dependency SBOM
Dependency SBOM not provided

Build instructions

Build the Python SDK adapter in src/ with python-arrow@2.1. See job.yaml for an example using the supplied fixtures.

Publisher-provided source, licenses and dependency information support your review. Availability and checksums do not certify safety, legal clearance, or that the executable matches the source.