piflow_multi_folder_json_parser
PiFlow · JSONRead JSON documents from two independently connected item collections and combine records by field name.
Use this operator
operator: piflow_multi_folder_json_parser@1.0Configure remote_operator_library_urls with this repository’s origin. XStream verifies and caches artifacts by digest, sharing them across operators.
Named ports
- leftInputitems
Items stream with file references. Matching Items are opened using their bytes view.
Formats: Any compatible format - rightInputitems
Items stream with file references. Matching Items are opened using their bytes view.
Formats: Any compatible format - resultOutputrecords
Records stream. Read JSON documents from two independently connected item collections and combine records by field name.
Output structure and samples are provided by operator inference.
Parameters
- tagstringRequired
Comma-separated fields to select. Use the empty string for all fields.
- How to fill
- Comma-separated fields to select. Use the empty string for all fields.
- Example value
Operator usage example
Connect the input ports to upstream steps and adjust the parameters for your data.
id: process
operator: piflow_multi_folder_json_parser@1.0
inputs:
left: read_left
right: read_right
params:
tag: ''
Manual download
curl -fLo 'operator.zip' 'https://repo.conox.cn/v1/blobs/sha256/cd706b31ac745b5c73c35b77c020f3f210237db475a4079942246eeff0f33d00/operator.zip'
sha256sum -- 'operator.zip'
curl -fLo 'LICENSE.txt' 'https://repo.conox.cn/v1/blobs/sha256/2a45ff20671144c1709be48b36f5e55d97145c767dae1cf91965cbd2cf625768/LICENSE.txt'
sha256sum -- 'LICENSE.txt'Compare checksums with the manifest. Download execution and build environments from the runtime catalog ↗.
Source and licensing
See Source archive under Artifact details
- Source repository
- https://github.com/cas-bigdatalab/piflow
- Source revision
- 6f254537683a4af28c2b89ca5f5ad51fb71153dd
- License (publisher declared)
- Apache-2.0
- License text
- Available below
- Dependency SBOM
- Dependency SBOM not provided
Build instructions
Build the Python SDK adapter in src/ with python-arrow@2.1. See job.yaml for an example using the supplied fixtures.
Publisher-provided source, licenses and dependency information support your review. Availability and checksums do not certify safety, legal clearance, or that the executable matches the source.