Operator catalog

More tags45

All operators

Showing 601–640 of 648
OperatorVersionsExecutorTrustDownloadsActions
piflow_multi_folder_json_parserAuthor dacp-examplesPiFlow · JSON

Read JSON documents from two independently connected item collections and combine records by field name.

python30.6 KiB3
piflow_multilayer_perceptron_predictionAuthor dacp-examplesPiFlow · Machine learning

Apply a trained Spark binary multilayer perceptron model to Arrow records and append prediction.

jvm22.6 KiB4
piflow_multilayer_perceptron_trainingAuthor dacp-examplesPiFlow · Machine learning

Train a Spark binary multilayer perceptron model on Arrow records and emit the trained model as a ZIP byte stream.

jvm21.3 KiB3
piflow_naive_bayes_predictionAuthor dacp-examplesPiFlow · Machine learning

Apply a trained Spark multinomial naive Bayes model to Arrow records and append prediction.

jvm22.5 KiB4
piflow_naive_bayes_trainingAuthor dacp-examplesPiFlow · Machine learning

Train a Spark multinomial naive Bayes model on Arrow records and emit the trained model as a ZIP byte stream.

jvm21.2 KiB3
piflow_pdf_parserAuthor dacp-examplesPiFlow · Documents

Extract native text from ordinary unencrypted PDF pages. Each record contains a page number and its text layer.

python820.3 KiB4
piflow_person_id_expansionAuthor dacp-examplesPiFlow · Data cleaning

Split a document type and number pair into the corresponding identity field and append deterministic source identifiers.

python30.3 KiB3
piflow_pf_coordinate_rotationAuthor dacp-examplesPiFlow · Data processing

EcoFlow planar-fit coordinate rotation using OLS and Breeze matrices. Params covariance/wind column names and output names. Requires a full-rank wind regression sample. Fixes upstream repeated Fc output into Le,Hs,u_star.

jvm193.7 KiB5
piflow_phone_number_cleanAuthor dacp-examplesPiFlow · Data cleaning

Normalize digits, remove separators and keep only mainland mobile numbers with upstream prefixes 13–15, 17 or 18. Replace the selected string columns while preserving other fields.

python12.6 KiB4
piflow_pie_chartAuthor dacp-examplesPiFlow · Visualization

Grouped pie-chart data as records, not an image. Params: dimension,indicator,indicatorOption COUNT/SUM/AVG/MAX/MIN. SQLite scalar aggregates, bounded 128 MiB. Output indicator_ACTION column.

python10.5 KiB5
piflow_pptx_parserAuthor dacp-examplesPiFlow · Documents

Extract paragraph text from PPTX slide parts in numerical part order, with the one-based slide number.

python19.9 KiB3
piflow_province_cleanAuthor dacp-examplesPiFlow · Data cleaning

Normalize common Chinese province names, suffixes and exact romanized names. Replace the selected string columns while preserving other fields.

python12.6 KiB4
piflow_rainfall_data_cullingAuthor dacp-examplesPiFlow · Data processing

EcoFlow rainfall quality control: flag selected flux columns at rainy timestamps and following 30 minutes. left=flux,right=meteorology; both require year,month,day,hour. Params fields,rainFallField,flagValue integer string. Upstream drops flux rows whose rainfall is null or unmatched.

jvm190.9 KiB5
piflow_random_forest_predictionAuthor dacp-examplesPiFlow · Machine learning

Apply a trained Spark random forest model to Arrow records and append prediction.

jvm22.6 KiB4
piflow_random_forest_trainingAuthor dacp-examplesPiFlow · Machine learning

Train a Spark random forest model on Arrow records and emit the trained model as a ZIP byte stream.

jvm21.2 KiB3
piflow_rdf_to_dfAuthor dacp-examplesPiFlow · Graphs

Parse RDF triples with explicit syntax. Output entity labels and literal properties, plus linked resources.

python1.1 MiB3
piflow_regex_text_processAuthor dacp-examplesPiFlow · Text

Append a text column with all matches of an RE2 regular expression replaced.

python30.3 KiB3
piflow_reichstein_checkAuthor dacp-examplesPiFlow · Data processing

EcoFlow Reichstein u-star screening implemented without Spark: six equal-count temperature groups, twenty wind bins, Pearson<0.4, median valid threshold; flag nighttime low-wind FC. Params soilTemperatureField,frictionWindSpeedField,FC strings,flagValue int32,percentFlux numeric(0,1]. Excludes null/nonfinite/flagged samples from estimation; requires120 valid observations. Fixes upper-bin bound and deterministic threshold order. Bounded128MiB.

python11.4 KiB5
piflow_routeAuthor dacp-examplesPiFlow · Filtering

Route by SQLite condition. Outputs: result (all rows), matched, unmatched (including SQL null predicates). Fixed ports replace dynamic PiFlow routing.

python8.8 KiB5
piflow_scatter_plot_chartAuthor dacp-examplesPiFlow · Visualization

Scatter-plot records, not an image. Params: legend column, customizedProperties mapping dimension column to unique integer order. Select legend and ordered dimensions; sort by legend then first dimension. SQLite scalar columns, bounded128MiB.

python11.3 KiB5
piflow_scope_normalizationAuthor dacp-examplesPiFlow · Statistics

Linearly map the observed minimum and maximum to a user-specified range. Constant values map to null.

python12.7 KiB4
piflow_select_fieldAuthor dacp-examplesPiFlow · Data processing

Select named record columns in order, incrementally by Arrow batch. Params: columnNames (comma-separated string).

python2.6 KiB8
piflow_select_files_by_nameAuthor dacp-examplesPiFlow · Files

Filter input path records on a case-sensitive filename glob and emit their original paths.

python30.3 KiB3
piflow_single_field_threshold_cleanAuthor dacp-examplesPiFlow · Data processing

EcoFlow inclusive field thresholds with an additional Spark SQL condition; replace invalid values with flagValue. Params: fields,maxValue,minValue,flagValue,additionalCondition (strings). Spark may coerce affected column types.

jvm191.0 KiB5
piflow_storage_item_ecAuthor dacp-examplesPiFlow · Data processing

EcoFlow EC CO2 storage correction for 30-minute observations sorted by day_id,hour. Params Fc,co2_Avg column names,para_H height metres string,flagValue numeric string. Adds id; retains upstream missing/large-jump condition.

jvm190.6 KiB5
piflow_storage_item_pm__hsAuthor dacp-examplesPiFlow · Data processing

EcoFlow seven-layer sensible heat profile storage correction. left flux,right meteorology; date columns year,month,day,hour. Params Hs,rho_a_Avg column names,equipmentHeightDifference seven metre heights,everyTaFields seven temperature columns,time_interval positive seconds string. Fixes ignored density column name.

jvm192.3 KiB5
piflow_storage_item_pm_leAuthor dacp-examplesPiFlow · Data processing

EcoFlow seven-layer latent heat profile storage correction. left flux,right meteorology; year,month,day,hour required. Params LE column,equipmentHeightDifference seven metre heights,everyTaFields seven Celsius columns,everyPvaporFields seven vapor-pressure columns,time_interval seconds string. Original vapor conversion216.5*p/(273.15+T).

jvm192.4 KiB5
piflow_subtractAuthor dacp-examplesPiFlow · Data processing

EXCEPT DISTINCT over whole rows: return unique left rows absent from right. Nulls compare equal for this set operation. No params. 128 MiB input limit each.

python8.9 KiB5
piflow_table_showAuthor dacp-examplesPiFlow · Visualization

Return table columns/expressions for client display. Params: showField (SQLite projection, default *). No chart rendering. Scalar columns, bounded 128 MiB.

python10.7 KiB5
piflow_title_cleanAuthor dacp-examplesPiFlow · Data cleaning

Convert full-width ASCII characters and ideographic spaces in titles. Replace the selected string columns while preserving other fields.

python12.6 KiB4
piflow_wild_spot_culling_mdv_gAuthor dacp-examplesPiFlow · Data processing

EcoFlow outlier removal from neighboring id windows, excluding current row. One field per step. Requires id; params fields,mdv_num positive odd string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream SQL syntax and undefined contrast_flag.

jvm192.0 KiB5
piflow_wild_spot_culling_mdv_iAuthor dacp-examplesPiFlow · Data processing

EcoFlow outlier removal in fixed windows ceiling(id/mdv_num). Requires id. Params fields (one column),mdv_num positive string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream ignored statistic.

jvm191.3 KiB5
piflow_word_spliterAuthor dacp-examplesPiFlow · Text

Remove whitespace and punctuation, then emit Jieba search-mode tokens in input order.

python43.0 KiB3
piflow_word_to_vecAuthor dacp-examplesPiFlow · Machine learning

Train Spark Word2Vec on the input corpus and append the mean token embedding for each document.

jvm21.1 KiB3
piflow_wpl_correctionAuthor dacp-examplesPiFlow · Data processing

EcoFlow WPL flux correction, preserves original conversions and five-decimal string output Fc,Le,Hs. All params are column-name strings. co2_Avg in mg/m3,h2o_Avg in g/m3,rho_a_Avg in kg/m3,Ts_Avg in Celsius. Requires non-null numeric columns.

jvm191.0 KiB5
piflow_xml_parserAuthor dacp-examplesPiFlow · XML

Parse repeated XML elements into string columns from direct child tags.

python12.6 KiB4
piflow_xml_parser_columnsAuthor dacp-examplesPiFlow · XML

Replace XML strings in selected record columns with JSON text, preserving other fields.

python12.6 KiB4
piflow_xml_parser_folderAuthor dacp-examplesPiFlow · XML

Read repeated XML elements from multiple documents and merge their direct text children by field name.

python30.5 KiB3
piflow_xml_parser_generate_new_fieldAuthor dacp-examplesPiFlow · XML

Add a string column containing text from a plain XML element path.

python19.9 KiB3
piflow_xml_saveAuthor dacp-examplesPiFlow · XML

Serialize scalar records as one XML document. ROWS wraps ROW elements; null fields are omitted.

python12.6 KiB4