Task Summary
Consume mounted datasets in Python UDFs — the final step of the dataset-mounting feature (part of #6606), built on per-computing-unit mounting.
Let a Python UDF bind mounted datasets to variables. Each binding maps a dataset version to a Python variable that, at runtime, holds the local filesystem path of the mounted dataset (e.g. open(f"{A}/file.csv")).
PythonUDFOpDescV2 — a list of (variableName -> dataset) bindings, validated as Python identifiers and resolved via FileResolver; the locators flow through PhysicalOp and WorkerConfig.DatasetMountManager — on the executor, ensures each bound dataset is mounted on the computing unit and hands its path to the Python worker, which injects it as a module-level variable (MOUNTED_DATASETS).- "Mounted dataset variables" property editor for the Python UDF.
Task Type
Task Summary
Consume mounted datasets in Python UDFs — the final step of the dataset-mounting feature (part of #6606), built on per-computing-unit mounting.
Let a Python UDF bind mounted datasets to variables. Each binding maps a dataset version to a Python variable that, at runtime, holds the local filesystem path of the mounted dataset (e.g.
open(f"{A}/file.csv")).PythonUDFOpDescV2— a list of(variableName -> dataset)bindings, validated as Python identifiers and resolved viaFileResolver; the locators flow throughPhysicalOpandWorkerConfig.DatasetMountManager— on the executor, ensures each bound dataset is mounted on the computing unit and hands its path to the Python worker, which injects it as a module-level variable (MOUNTED_DATASETS).Task Type