Operator catalog

More tags45

All operators

Showing 521–560 of 638
OperatorVersionsExecutorTrustDownloadsActions
hydro_susceptibilityAuthor renhaoData processing · siltdam

Select hydrologically susceptible gullies from slope and entropy streams.

python3.4 KiB3
item_byte_countAuthor dacp-examplesTransform · Items

Open Item byte views on demand and report each URI and its byte count.

jvm18.8 KiB2
item_inventoryAuthor dacp-examplesTransform · Items

List Item URI, kind and format without opening member contents.

jvm18.8 KiB1
observatory_crossmatchAuthor dacp-examplesCONET

Synthetic three-observatory crossmatch

python8.3 KiB3
observatory_selectAuthor dacp-examplesCONET

Synthetic three-observatory select

python8.3 KiB3
overlap_dam_selectAuthor renhaoData processing · siltdam

Match geographic detections with selected hydrological channels in a drainage raster.

python3.6 KiB3
piflow_add_day_idAuthor dacp-examplesPiFlow · Data processing

Spark EcoFlow: sort year/month/day/hour; add id and day_id. Params: partitionNum string. Inputs materialized, max 128 MiB / one million rows.

jvm189.9 KiB7
piflow_add_day_stateAuthor dacp-examplesPiFlow · Data processing

EcoFlow sunrise/sunset day/night classifier using longitude, latitude and day_id (day-of-year); hour uses Beijing time. Params: longitude, latitude as strings. Spark batch, 128 MiB input limit.

jvm190.2 KiB6
piflow_add_uuid_stopAuthor dacp-examplesPiFlow · Data processing

Prepend a distinct 32-character hexadecimal UUID per row. Params: column (new column name).

python9.2 KiB6
piflow_all_fields_clean_neo4jAuthor dacp-examplesPiFlow · Graphs

Convert scalar fields to text and remove double quotation marks. Preserve nulls.

python35.7 KiB3
piflow_average_temperatureAuthor dacp-examplesPiFlow · Statistics

Convert Fahrenheit readings to Celsius and compute one mean per sensor and one-second event-time window.

python35.7 KiB4
piflow_batch_field_threshold_cleanAuthor dacp-examplesPiFlow · Data processing

EcoFlow inclusive threshold cleaning. left: records to clean; right: field,min_value,max_value,flag_value threshold records. No params. Fixes upstream Row-to-string field matching; field names must match exactly. Spark may coerce affected column types.

jvm189.6 KiB6
piflow_bisecting_kmeans_predictionAuthor dacp-examplesPiFlow · Machine learning

Apply a trained Spark bisecting k-means model to Arrow records and append prediction.

jvm22.6 KiB5
piflow_bisecting_kmeans_trainingAuthor dacp-examplesPiFlow · Machine learning

Train a Spark bisecting k-means model on Arrow records and emit the trained model as a ZIP byte stream.

jvm21.2 KiB4
piflow_card_code_cleanAuthor dacp-examplesPiFlow · Data cleaning

Normalize the configured identity column for document type 1. Preserve all other document numbers.

python30.2 KiB4
piflow_column_checkAuthor dacp-examplesPiFlow · Data processing

Validate full ordered column names against a reference and return left input. Params: none. Inputs: left, right. Left-input buffering limit: 128 MiB. Does not check physical units.

python8.6 KiB6
piflow_complement_by_memcacheAuthor dacp-examplesPiFlow · Data processing

Replace selected columns on a lookup key hit. Rows without a matching key keep their original values.

python35.7 KiB4
piflow_consistency_checkAuthor dacp-examplesPiFlow · Data processing

Left-join reference keys; prepend flagField=0 for matches, 1 otherwise. Params: flagField, correlationColumn (comma-separated). Duplicate reference keys retain join multiplicity. 128 MiB input limit each.

python9.7 KiB6
piflow_convert_schemaAuthor dacp-examplesPiFlow · Data processing

Rename columns; does not cast data types. Params: schema, e.g. station_id->station,temperature->air_c.

python9.1 KiB6
piflow_convert_schema_typeAuthor dacp-examplesPiFlow · Data conversion

Convert all input fields to text or cast selected fields to string and 32-bit integer.

python43.0 KiB3
piflow_csv_parserAuthor dacp-examplesData transformation · CSV

Stream UTF-8 CSV bytes to Arrow string columns. Params: header (bool, default true), delimiter (one character), schema (names for headerless input). No csvPath; quoted fields supported. No type inference.

jvm47.4 KiB10
piflow_csv_saveAuthor dacp-examplesData transformation · CSV

Serialize record batches as a UTF-8 CSV byte stream. Params: header (bool, default true), delimiter (one character, default comma). No destination path or file side effect.

jvm48.5 KiB11
piflow_csv_string_parserAuthor dacp-examplesPiFlow · CSV · Data conversion

Parse headerless UTF-8 CSV text bytes to string records. Params: delimiter, schema; absent schema generates _0, _1, etc. Input stream replaces PiFlow string property.

python8.3 KiB6
piflow_current_and_post_value_interpolationAuthor dacp-examplesPiFlow · Data processing

Interpolate two consecutive missing same-hour daily observations between valid endpoints. Requires year,month,day,hour. Params fields,qualityControlMarkerValue string. Fixes ignored marker and upstream absolute-difference error to support decreasing series.

jvm190.8 KiB6
piflow_custom_viewAuthor dacp-examplesPiFlow · Visualization · CSV

Custom view exported as UTF-8 CSV byte stream with a header. Replaces upstream HDFS visualization file with an output stream; no params, no rendering.

python9.3 KiB6
piflow_data_sortAuthor dacp-examplesPiFlow · Data processing

Globally sort a bounded input on one or more fields. Ascending order places nulls first, and descending places them last.

python35.7 KiB4
piflow_decision_tree_predictionAuthor dacp-examplesPiFlow · Machine learning

Apply a trained Spark decision tree model to Arrow records and append prediction.

jvm22.5 KiB6
piflow_decision_tree_trainingAuthor dacp-examplesPiFlow · Machine learning

Train a Spark decision tree model on Arrow records and emit the trained model as a ZIP byte stream.

jvm21.2 KiB5
piflow_decompress_gzipAuthor dacp-examplesPiFlow · Archives

Decode the gzip member stream and return bytes. A tar.gz input returns the decompressed TAR bytes.

python19.9 KiB4
piflow_discretizationAuthor dacp-examplesPiFlow · Statistics

Assign zero-based numeric bins using upstream equal-width unit cuts or exact equal-frequency quantiles.

python12.6 KiB5
piflow_distinctAuthor dacp-examplesPiFlow · Data processing

Deduplicate records across Arrow batches; retains the first row per key. Params: optional columnNames; empty means all columns. Key-state limit: 128 MiB.

python9.0 KiB6
piflow_docx_parserAuthor dacp-examplesPiFlow · Documents

Extract nonempty text paragraphs from the main document part of a DOCX package, in document order.

python19.9 KiB4
piflow_dr_coordinate_rotationAuthor dacp-examplesPiFlow · Data processing

EcoFlow double coordinate rotation. Params map covariance/wind columns and output Fc,Le,Hs,u_star names. Nonzero horizontal wind required; outputs five-decimal strings. Original Breeze matrix algorithm.

jvm193.7 KiB6
piflow_drop_fieldAuthor dacp-examplesPiFlow · Data processing

Remove record columns incrementally. Params: columnNames (comma-separated string); absent names ignored.

python9.2 KiB6
piflow_email_cleanAuthor dacp-examplesPiFlow · Data cleaning

Convert full-width characters, lowercase the address and return an empty string for malformed addresses. Replace the selected string columns while preserving other fields.

python12.6 KiB5
piflow_evaluate_json_pathAuthor dacp-examplesPiFlow · JSON

Extract one field from each JSON object. Dot-separated paths traverse nested objects; missing fields return null.

python19.9 KiB4
piflow_excel_parserAuthor dacp-examplesPiFlow · Excel

Read the first sheet of each XLS or XLSX Item. Normalize first-row headers and merge string columns by name.

python699.8 KiB4
piflow_excel_readAuthor dacp-examplesPiFlow · Data conversion

XLSX byte stream to string records (no inference), dates as ISO strings, blanks null, cached formula values only. Params optional header boolean(default true),dataAddress [Sheet!]A1[:F35]. Replaces filePath with source bytes. Limits compressed/expanded128MiB and one million selected cells; materializes workbook bytes, preserves worksheet selection. No legacy XLS.

python519.3 KiB9
piflow_excel_writeAuthor dacp-examplesPiFlow · Data conversion

Records to XLSX byte stream; replaces filePath/saveMode with a new workbook output. Params optional header boolean(default true),dataAddress start cell e.g. Sheet1!A1 (no bounded write ranges). Dates become ISO text, formula-looking strings remain text. Bounded128MiB/one million rows; temporary XLSX serialization, not constant-memory streaming. Vendored openpyxl3.1.5/et_xmlfile2.0.0.

python518.5 KiB6
piflow_excel_write_multiple_sheetsAuthor dacp-examplesPiFlow · Excel

Write one worksheet for each of the left and right record inputs, and return one XLSX stream.

python538.5 KiB4