Operator catalog
| Operator | Versions | Executor | Trust | Downloads | Actions |
|---|---|---|---|---|---|
galaxy_xgmml_to_pajekGalaxy · Data conversion · Data transformation Convert XGMML to Pajek. | python24.2 KiB | 3 | |||
geo_entropyData processing · siltdam Calculate hydrological entropy for catchment zones from DEM and catchment rasters. | python4.8 KiB | 4 | |||
geotransData processing · siltdam Convert paired YOLO label and world-file Item collections into geographic detection coordinates. | python4.8 KiB | 4 | |||
gully_slopsiltdam · Data processing Calculate gully slope from a channel CSV stream and a DEM GeoTIFF stream. | python3.6 KiB | 3 | |||
hydro_susceptibilityData processing · siltdam Select hydrologically susceptible gullies from slope and entropy streams. | python3.4 KiB | 3 | |||
item_byte_countTransform · Items Open Item byte views on demand and report each URI and its byte count. | jvm18.8 KiB | 2 | |||
item_inventoryTransform · Items List Item URI, kind and format without opening member contents. | jvm18.8 KiB | 1 | |||
item_sourceStreams · Source Read a selected catalog Item View as a stream. | stream45 B | 23 | |||
min_lines_sinkSink · Validation Fail the Job unless a byte stream contains a minimum number of lines. | jvm23.4 KiB | 1 | |||
Synthetic three-observatory crossmatch | python8.3 KiB | 3 | |||
observatory_selectCONET Synthetic three-observatory select | python8.3 KiB | 3 | |||
overlap_dam_selectData processing · siltdam Match geographic detections with selected hydrological channels in a drainage raster. | python3.6 KiB | 3 | |||
piflow_add_day_idPiFlow · Data processing Spark EcoFlow: sort year/month/day/hour; add id and day_id. Params: partitionNum string. Inputs materialized, max 128 MiB / one million rows. | jvm189.9 KiB | 7 | |||
piflow_add_day_statePiFlow · Data processing EcoFlow sunrise/sunset day/night classifier using longitude, latitude and day_id (day-of-year); hour uses Beijing time. Params: longitude, latitude as strings. Spark batch, 128 MiB input limit. | jvm190.2 KiB | 6 | |||
piflow_add_uuid_stopPiFlow · Data processing Prepend a distinct 32-character hexadecimal UUID per row. Params: column (new column name). | python9.2 KiB | 6 | |||
piflow_all_fields_clean_neo4jPiFlow · Graphs Convert scalar fields to text and remove double quotation marks. Preserve nulls. | python35.7 KiB | 3 | |||
piflow_average_temperaturePiFlow · Statistics Convert Fahrenheit readings to Celsius and compute one mean per sensor and one-second event-time window. | python35.7 KiB | 4 | |||
piflow_batch_field_threshold_cleanPiFlow · Data processing EcoFlow inclusive threshold cleaning. left: records to clean; right: field,min_value,max_value,flag_value threshold records. No params. Fixes upstream Row-to-string field matching; field names must match exactly. Spark may coerce affected column types. | jvm189.6 KiB | 6 | |||
piflow_bisecting_kmeans_predictionPiFlow · Machine learning Apply a trained Spark bisecting k-means model to Arrow records and append prediction. | jvm22.6 KiB | 5 | |||
piflow_bisecting_kmeans_trainingPiFlow · Machine learning Train a Spark bisecting k-means model on Arrow records and emit the trained model as a ZIP byte stream. | jvm21.2 KiB | 4 | |||
piflow_card_code_cleanPiFlow · Data cleaning Normalize the configured identity column for document type 1. Preserve all other document numbers. | python30.2 KiB | 4 | |||
piflow_column_checkPiFlow · Data processing Validate full ordered column names against a reference and return left input. Params: none. Inputs: left, right. Left-input buffering limit: 128 MiB. Does not check physical units. | python8.6 KiB | 6 | |||
piflow_complement_by_memcachePiFlow · Data processing Replace selected columns on a lookup key hit. Rows without a matching key keep their original values. | python35.7 KiB | 4 | |||
piflow_consistency_checkPiFlow · Data processing Left-join reference keys; prepend flagField=0 for matches, 1 otherwise. Params: flagField, correlationColumn (comma-separated). Duplicate reference keys retain join multiplicity. 128 MiB input limit each. | python9.7 KiB | 6 | |||
piflow_convert_schemaPiFlow · Data processing Rename columns; does not cast data types. Params: schema, e.g. station_id->station,temperature->air_c. | python9.1 KiB | 6 | |||
piflow_convert_schema_typePiFlow · Data conversion Convert all input fields to text or cast selected fields to string and 32-bit integer. | python43.0 KiB | 3 | |||
piflow_csv_parserData transformation · CSV Stream UTF-8 CSV bytes to Arrow string columns. Params: header (bool, default true), delimiter (one character), schema (names for headerless input). No csvPath; quoted fields supported. No type inference. | jvm47.4 KiB | 10 | |||
piflow_csv_saveData transformation · CSV Serialize record batches as a UTF-8 CSV byte stream. Params: header (bool, default true), delimiter (one character, default comma). No destination path or file side effect. | jvm48.5 KiB | 11 | |||
piflow_csv_string_parserPiFlow · CSV · Data conversion Parse headerless UTF-8 CSV text bytes to string records. Params: delimiter, schema; absent schema generates _0, _1, etc. Input stream replaces PiFlow string property. | python8.3 KiB | 6 | |||
piflow_current_and_post_value_interpolationPiFlow · Data processing Interpolate two consecutive missing same-hour daily observations between valid endpoints. Requires year,month,day,hour. Params fields,qualityControlMarkerValue string. Fixes ignored marker and upstream absolute-difference error to support decreasing series. | jvm190.8 KiB | 6 | |||
piflow_custom_viewPiFlow · Visualization · CSV Custom view exported as UTF-8 CSV byte stream with a header. Replaces upstream HDFS visualization file with an output stream; no params, no rendering. | python9.3 KiB | 6 | |||
piflow_data_sortPiFlow · Data processing Globally sort a bounded input on one or more fields. Ascending order places nulls first, and descending places them last. | python35.7 KiB | 4 | |||
piflow_decision_tree_predictionPiFlow · Machine learning Apply a trained Spark decision tree model to Arrow records and append prediction. | jvm22.5 KiB | 6 | |||
piflow_decision_tree_trainingPiFlow · Machine learning Train a Spark decision tree model on Arrow records and emit the trained model as a ZIP byte stream. | jvm21.2 KiB | 5 | |||
piflow_decompress_gzipPiFlow · Archives Decode the gzip member stream and return bytes. A tar.gz input returns the decompressed TAR bytes. | python19.9 KiB | 4 | |||
piflow_discretizationPiFlow · Statistics Assign zero-based numeric bins using upstream equal-width unit cuts or exact equal-frequency quantiles. | python12.6 KiB | 5 | |||
piflow_distinctPiFlow · Data processing Deduplicate records across Arrow batches; retains the first row per key. Params: optional columnNames; empty means all columns. Key-state limit: 128 MiB. | python9.0 KiB | 6 | |||
piflow_docx_parserPiFlow · Documents Extract nonempty text paragraphs from the main document part of a DOCX package, in document order. | python19.9 KiB | 4 | |||
piflow_dr_coordinate_rotationPiFlow · Data processing EcoFlow double coordinate rotation. Params map covariance/wind columns and output Fc,Le,Hs,u_star names. Nonzero horizontal wind required; outputs five-decimal strings. Original Breeze matrix algorithm. | jvm193.7 KiB | 6 | |||
piflow_drop_fieldPiFlow · Data processing Remove record columns incrementally. Params: columnNames (comma-separated string); absent names ignored. | python9.2 KiB | 6 |