Operator catalog

More tags45

All operators

Showing 81–104 of 104
OperatorVersionsExecutorTrustDownloadsActions
piflow_routeAuthor dacp-examplesPiFlow · Filtering

Route by SQLite condition. Outputs: result (all rows), matched, unmatched (including SQL null predicates). Fixed ports replace dynamic PiFlow routing.

python8.8 KiB5
piflow_scatter_plot_chartAuthor dacp-examplesPiFlow · Visualization

Scatter-plot records, not an image. Params: legend column, customizedProperties mapping dimension column to unique integer order. Select legend and ordered dimensions; sort by legend then first dimension. SQLite scalar columns, bounded128MiB.

python11.3 KiB5
piflow_scope_normalizationAuthor dacp-examplesPiFlow · Statistics

Linearly map the observed minimum and maximum to a user-specified range. Constant values map to null.

python12.7 KiB4
piflow_select_fieldAuthor dacp-examplesPiFlow · Data processing

Select named record columns in order, incrementally by Arrow batch. Params: columnNames (comma-separated string).

python2.6 KiB8
piflow_select_files_by_nameAuthor dacp-examplesPiFlow · Files

Filter input path records on a case-sensitive filename glob and emit their original paths.

python30.3 KiB3
piflow_single_field_threshold_cleanAuthor dacp-examplesPiFlow · Data processing

EcoFlow inclusive field thresholds with an additional Spark SQL condition; replace invalid values with flagValue. Params: fields,maxValue,minValue,flagValue,additionalCondition (strings). Spark may coerce affected column types.

jvm191.0 KiB5
piflow_storage_item_ecAuthor dacp-examplesPiFlow · Data processing

EcoFlow EC CO2 storage correction for 30-minute observations sorted by day_id,hour. Params Fc,co2_Avg column names,para_H height metres string,flagValue numeric string. Adds id; retains upstream missing/large-jump condition.

jvm190.6 KiB5
piflow_storage_item_pm__hsAuthor dacp-examplesPiFlow · Data processing

EcoFlow seven-layer sensible heat profile storage correction. left flux,right meteorology; date columns year,month,day,hour. Params Hs,rho_a_Avg column names,equipmentHeightDifference seven metre heights,everyTaFields seven temperature columns,time_interval positive seconds string. Fixes ignored density column name.

jvm192.3 KiB5
piflow_storage_item_pm_leAuthor dacp-examplesPiFlow · Data processing

EcoFlow seven-layer latent heat profile storage correction. left flux,right meteorology; year,month,day,hour required. Params LE column,equipmentHeightDifference seven metre heights,everyTaFields seven Celsius columns,everyPvaporFields seven vapor-pressure columns,time_interval seconds string. Original vapor conversion216.5*p/(273.15+T).

jvm192.4 KiB5
piflow_subtractAuthor dacp-examplesPiFlow · Data processing

EXCEPT DISTINCT over whole rows: return unique left rows absent from right. Nulls compare equal for this set operation. No params. 128 MiB input limit each.

python8.9 KiB5
piflow_table_showAuthor dacp-examplesPiFlow · Visualization

Return table columns/expressions for client display. Params: showField (SQLite projection, default *). No chart rendering. Scalar columns, bounded 128 MiB.

python10.7 KiB5
piflow_title_cleanAuthor dacp-examplesPiFlow · Data cleaning

Convert full-width ASCII characters and ideographic spaces in titles. Replace the selected string columns while preserving other fields.

python12.6 KiB4
piflow_wild_spot_culling_mdv_gAuthor dacp-examplesPiFlow · Data processing

EcoFlow outlier removal from neighboring id windows, excluding current row. One field per step. Requires id; params fields,mdv_num positive odd string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream SQL syntax and undefined contrast_flag.

jvm192.0 KiB5
piflow_wild_spot_culling_mdv_iAuthor dacp-examplesPiFlow · Data processing

EcoFlow outlier removal in fixed windows ceiling(id/mdv_num). Requires id. Params fields (one column),mdv_num positive string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream ignored statistic.

jvm191.3 KiB5
piflow_word_spliterAuthor dacp-examplesPiFlow · Text

Remove whitespace and punctuation, then emit Jieba search-mode tokens in input order.

python43.0 KiB3
piflow_word_to_vecAuthor dacp-examplesPiFlow · Machine learning

Train Spark Word2Vec on the input corpus and append the mean token embedding for each document.

jvm21.1 KiB3
piflow_wpl_correctionAuthor dacp-examplesPiFlow · Data processing

EcoFlow WPL flux correction, preserves original conversions and five-decimal string output Fc,Le,Hs. All params are column-name strings. co2_Avg in mg/m3,h2o_Avg in g/m3,rho_a_Avg in kg/m3,Ts_Avg in Celsius. Requires non-null numeric columns.

jvm191.0 KiB5
piflow_xml_parserAuthor dacp-examplesPiFlow · XML

Parse repeated XML elements into string columns from direct child tags.

python12.6 KiB4
piflow_xml_parser_columnsAuthor dacp-examplesPiFlow · XML

Replace XML strings in selected record columns with JSON text, preserving other fields.

python12.6 KiB4
piflow_xml_parser_folderAuthor dacp-examplesPiFlow · XML

Read repeated XML elements from multiple documents and merge their direct text children by field name.

python30.5 KiB3
piflow_xml_parser_generate_new_fieldAuthor dacp-examplesPiFlow · XML

Add a string column containing text from a plain XML element path.

python19.9 KiB3
piflow_xml_saveAuthor dacp-examplesPiFlow · XML

Serialize scalar records as one XML document. ROWS wraps ROW elements; null fields are omitted.

python12.6 KiB4
piflow_xml_string_parserAuthor dacp-examplesPiFlow · XML

Read selected direct child elements from repeated XML rows supplied as a literal parameter.

python12.6 KiB4
piflow_z_scoreAuthor dacp-examplesPiFlow · Statistics

Standardize numeric columns with their sample standard deviations. A zero or undefined standard deviation produces nulls.

python12.6 KiB4