Operator catalog
| Operator | Versions | Executor | Trust | Downloads | Actions |
|---|---|---|---|---|---|
piflow_multi_folder_json_parserPiFlow · JSON Read JSON documents from two independently connected item collections and combine records by field name. | python30.6 KiB | 3 | |||
piflow_multilayer_perceptron_predictionPiFlow · Machine learning Apply a trained Spark binary multilayer perceptron model to Arrow records and append prediction. | jvm22.6 KiB | 4 | |||
piflow_multilayer_perceptron_trainingPiFlow · Machine learning Train a Spark binary multilayer perceptron model on Arrow records and emit the trained model as a ZIP byte stream. | jvm21.3 KiB | 3 | |||
piflow_naive_bayes_predictionPiFlow · Machine learning Apply a trained Spark multinomial naive Bayes model to Arrow records and append prediction. | jvm22.5 KiB | 4 | |||
piflow_naive_bayes_trainingPiFlow · Machine learning Train a Spark multinomial naive Bayes model on Arrow records and emit the trained model as a ZIP byte stream. | jvm21.2 KiB | 3 | |||
piflow_pdf_parserPiFlow · Documents Extract native text from ordinary unencrypted PDF pages. Each record contains a page number and its text layer. | python820.3 KiB | 4 | |||
piflow_person_id_expansionPiFlow · Data cleaning Split a document type and number pair into the corresponding identity field and append deterministic source identifiers. | python30.3 KiB | 3 | |||
piflow_pf_coordinate_rotationPiFlow · Data processing EcoFlow planar-fit coordinate rotation using OLS and Breeze matrices. Params covariance/wind column names and output names. Requires a full-rank wind regression sample. Fixes upstream repeated Fc output into Le,Hs,u_star. | jvm193.7 KiB | 5 | |||
piflow_phone_number_cleanPiFlow · Data cleaning Normalize digits, remove separators and keep only mainland mobile numbers with upstream prefixes 13–15, 17 or 18. Replace the selected string columns while preserving other fields. | python12.6 KiB | 4 | |||
piflow_pie_chartPiFlow · Visualization Grouped pie-chart data as records, not an image. Params: dimension,indicator,indicatorOption COUNT/SUM/AVG/MAX/MIN. SQLite scalar aggregates, bounded 128 MiB. Output indicator_ACTION column. | python10.5 KiB | 5 | |||
piflow_pptx_parserPiFlow · Documents Extract paragraph text from PPTX slide parts in numerical part order, with the one-based slide number. | python19.9 KiB | 3 | |||
piflow_province_cleanPiFlow · Data cleaning Normalize common Chinese province names, suffixes and exact romanized names. Replace the selected string columns while preserving other fields. | python12.6 KiB | 4 | |||
piflow_rainfall_data_cullingPiFlow · Data processing EcoFlow rainfall quality control: flag selected flux columns at rainy timestamps and following 30 minutes. left=flux,right=meteorology; both require year,month,day,hour. Params fields,rainFallField,flagValue integer string. Upstream drops flux rows whose rainfall is null or unmatched. | jvm190.9 KiB | 5 | |||
piflow_random_forest_predictionPiFlow · Machine learning Apply a trained Spark random forest model to Arrow records and append prediction. | jvm22.6 KiB | 4 | |||
piflow_random_forest_trainingPiFlow · Machine learning Train a Spark random forest model on Arrow records and emit the trained model as a ZIP byte stream. | jvm21.2 KiB | 3 | |||
piflow_rdf_to_dfPiFlow · Graphs Parse RDF triples with explicit syntax. Output entity labels and literal properties, plus linked resources. | python1.1 MiB | 3 | |||
piflow_regex_text_processPiFlow · Text Append a text column with all matches of an RE2 regular expression replaced. | python30.3 KiB | 3 | |||
piflow_reichstein_checkPiFlow · Data processing EcoFlow Reichstein u-star screening implemented without Spark: six equal-count temperature groups, twenty wind bins, Pearson<0.4, median valid threshold; flag nighttime low-wind FC. Params soilTemperatureField,frictionWindSpeedField,FC strings,flagValue int32,percentFlux numeric(0,1]. Excludes null/nonfinite/flagged samples from estimation; requires120 valid observations. Fixes upper-bin bound and deterministic threshold order. Bounded128MiB. | python11.4 KiB | 5 | |||
piflow_routePiFlow · Filtering Route by SQLite condition. Outputs: result (all rows), matched, unmatched (including SQL null predicates). Fixed ports replace dynamic PiFlow routing. | python8.8 KiB | 5 | |||
piflow_scatter_plot_chartPiFlow · Visualization Scatter-plot records, not an image. Params: legend column, customizedProperties mapping dimension column to unique integer order. Select legend and ordered dimensions; sort by legend then first dimension. SQLite scalar columns, bounded128MiB. | python11.3 KiB | 5 | |||
piflow_scope_normalizationPiFlow · Statistics Linearly map the observed minimum and maximum to a user-specified range. Constant values map to null. | python12.7 KiB | 4 | |||
piflow_select_fieldPiFlow · Data processing Select named record columns in order, incrementally by Arrow batch. Params: columnNames (comma-separated string). | python2.6 KiB | 8 | |||
piflow_select_files_by_namePiFlow · Files Filter input path records on a case-sensitive filename glob and emit their original paths. | python30.3 KiB | 3 | |||
piflow_single_field_threshold_cleanPiFlow · Data processing EcoFlow inclusive field thresholds with an additional Spark SQL condition; replace invalid values with flagValue. Params: fields,maxValue,minValue,flagValue,additionalCondition (strings). Spark may coerce affected column types. | jvm191.0 KiB | 5 | |||
piflow_storage_item_ecPiFlow · Data processing EcoFlow EC CO2 storage correction for 30-minute observations sorted by day_id,hour. Params Fc,co2_Avg column names,para_H height metres string,flagValue numeric string. Adds id; retains upstream missing/large-jump condition. | jvm190.6 KiB | 5 | |||
piflow_storage_item_pm__hsPiFlow · Data processing EcoFlow seven-layer sensible heat profile storage correction. left flux,right meteorology; date columns year,month,day,hour. Params Hs,rho_a_Avg column names,equipmentHeightDifference seven metre heights,everyTaFields seven temperature columns,time_interval positive seconds string. Fixes ignored density column name. | jvm192.3 KiB | 5 | |||
piflow_storage_item_pm_lePiFlow · Data processing EcoFlow seven-layer latent heat profile storage correction. left flux,right meteorology; year,month,day,hour required. Params LE column,equipmentHeightDifference seven metre heights,everyTaFields seven Celsius columns,everyPvaporFields seven vapor-pressure columns,time_interval seconds string. Original vapor conversion216.5*p/(273.15+T). | jvm192.4 KiB | 5 | |||
piflow_subtractPiFlow · Data processing EXCEPT DISTINCT over whole rows: return unique left rows absent from right. Nulls compare equal for this set operation. No params. 128 MiB input limit each. | python8.9 KiB | 5 | |||
piflow_table_showPiFlow · Visualization Return table columns/expressions for client display. Params: showField (SQLite projection, default *). No chart rendering. Scalar columns, bounded 128 MiB. | python10.7 KiB | 5 | |||
piflow_title_cleanPiFlow · Data cleaning Convert full-width ASCII characters and ideographic spaces in titles. Replace the selected string columns while preserving other fields. | python12.6 KiB | 4 | |||
piflow_wild_spot_culling_mdv_gPiFlow · Data processing EcoFlow outlier removal from neighboring id windows, excluding current row. One field per step. Requires id; params fields,mdv_num positive odd string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream SQL syntax and undefined contrast_flag. | jvm192.0 KiB | 5 | |||
piflow_wild_spot_culling_mdv_iPiFlow · Data processing EcoFlow outlier removal in fixed windows ceiling(id/mdv_num). Requires id. Params fields (one column),mdv_num positive string,multiple nonnegative string,statisticalType stddev/variance,flagValue numeric string. Fixes upstream ignored statistic. | jvm191.3 KiB | 5 | |||
piflow_word_spliterPiFlow · Text Remove whitespace and punctuation, then emit Jieba search-mode tokens in input order. | python43.0 KiB | 3 | |||
piflow_word_to_vecPiFlow · Machine learning Train Spark Word2Vec on the input corpus and append the mean token embedding for each document. | jvm21.1 KiB | 3 | |||
piflow_wpl_correctionPiFlow · Data processing EcoFlow WPL flux correction, preserves original conversions and five-decimal string output Fc,Le,Hs. All params are column-name strings. co2_Avg in mg/m3,h2o_Avg in g/m3,rho_a_Avg in kg/m3,Ts_Avg in Celsius. Requires non-null numeric columns. | jvm191.0 KiB | 5 | |||
piflow_xml_parserPiFlow · XML Parse repeated XML elements into string columns from direct child tags. | python12.6 KiB | 4 | |||
piflow_xml_parser_columnsPiFlow · XML Replace XML strings in selected record columns with JSON text, preserving other fields. | python12.6 KiB | 4 | |||
piflow_xml_parser_folderPiFlow · XML Read repeated XML elements from multiple documents and merge their direct text children by field name. | python30.5 KiB | 3 | |||
piflow_xml_parser_generate_new_fieldPiFlow · XML Add a string column containing text from a plain XML element path. | python19.9 KiB | 3 | |||
piflow_xml_savePiFlow · XML Serialize scalar records as one XML document. ROWS wraps ROW elements; null fields are omitted. | python12.6 KiB | 4 |