Operator catalog

More tags45

All operators

Showing 1–6 of 6
OperatorVersionsExecutorTrustDownloadsActions
piflow_csv_parserAuthor dacp-examplesData transformation · CSV

Stream UTF-8 CSV bytes to Arrow string columns. Params: header (bool, default true), delimiter (one character), schema (names for headerless input). No csvPath; quoted fields supported. No type inference.

jvm47.4 KiB10
piflow_csv_saveAuthor dacp-examplesData transformation · CSV

Serialize record batches as a UTF-8 CSV byte stream. Params: header (bool, default true), delimiter (one character, default comma). No destination path or file side effect.

jvm48.5 KiB11
piflow_execute_sql_stopAuthor dacp-examplesData transformation · SQL

Read-only SQLite SQL over a named input relation (not Spark SQL). Params: sql, viewName. Scalar inputs, max 128 MiB. Output types inferred; empty computed columns have null type.

jvm61.0 KiB6
piflow_filterAuthor dacp-examplesData transformation · SQL

Filter Arrow batches by a SQLite SQL predicate (not Spark SQL). Params: condition, e.g. quality = 0 AND temperature >= 12. Scalar columns only.

jvm61.0 KiB9
piflow_joinAuthor dacp-examplesData transformation · Relational

Key-based inner/left/right/full_outer record join. Params: joinMode, correlationColumn. Colliding right non-key columns receive _right suffix. 128 MiB per input.

jvm52.0 KiB8
piflow_mergeAuthor dacp-examplesData transformation · Relational

Stream left records followed by right records, retaining duplicates. Merge schemas by field name: preserve left field order, append right-only fields and fill missing values with null. Conflicting types are rejected. No params. Fixed left/right ports.

jvm52.0 KiB11