OPERATOR / VERSION 1.0

piflow_select_files_by_name

PiFlow · Files

Filter input path records on a case-sensitive filename glob and emit their original paths.

View manifest JSON ↗

Use this operator

operator: piflow_select_files_by_name@1.0

Configure remote_operator_library_urls with this repository’s origin. XStream verifies and caches artifacts by digest, sharing them across operators.

Named ports

  • sourceInputrecords

    Arrow records. The example uses path.

    Formats: Any compatible format
  • resultOutputrecords

    Records stream. Filter input path records on a case-sensitive filename glob and emit their original paths.

Output structure and samples are provided by operator inference.

Parameters

  • selectionConditionsstringRequired

    A glob matched against the final path segment.

    How to fill
    A glob matched against the final path segment. · Maximum length: 256
    Example value
    *.csv
  • pathColumnstringRequired

    Column containing logical paths.

    How to fill
    Column containing logical paths.
    Example value
    path

Operator usage example

Connect the input ports to upstream steps and adjust the parameters for your data.

id: process
operator: piflow_select_files_by_name@1.0
inputs:
  source: read_source
params:
  selectionConditions: '*.csv'
  pathColumn: path

Manual download

curl -fLo 'operator.zip' 'https://repo.conox.cn/v1/blobs/sha256/5f96e1b30befd0eff38502fbbd0f68994861a36384c5b47059a527961d71a9b3/operator.zip'
sha256sum -- 'operator.zip'
curl -fLo 'LICENSE.txt' 'https://repo.conox.cn/v1/blobs/sha256/c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4/LICENSE.txt'
sha256sum -- 'LICENSE.txt'

Compare checksums with the manifest. Download execution and build environments from the runtime catalog ↗.

Source and licensing

See Source archive under Artifact details

Source repository
https://github.com/cas-bigdatalab/piflow
Source revision
777361c4e72b2c5457479683916b7c8e635289ff
License (publisher declared)
Apache-2.0
License text
Available below
Dependency SBOM
Dependency SBOM not provided

Build instructions

Build the Python SDK adapter in src/ with python-arrow@2.0. See job.yaml for an example using the supplied fixtures.

Publisher-provided source, licenses and dependency information support your review. Availability and checksums do not certify safety, legal clearance, or that the executable matches the source.