ogdc_runner.models.parallel_config module¶

Models for parallel execution orchestration.

Note: ParallelConfig is in recipe_config.py since it’s recipe configuration. This module contains execution-related models used by the parallel orchestrator.

class ogdc_runner.models.parallel_config.ExecutionFunction(**data: Any) → None¶

Bases: OgdcBaseModel

Represents a function or command to execute in parallel.

Exactly one of command or function must be specified.

name¶: Unique identifier for this execution function

command¶: Shell command to execute (for shell workflows)

function¶: Python callable (for Hera @script decorated functions)

Parameters:

data (Any)
name (str)
command (str | None)
function (Callable[[...], Any] | None)

command: str | None¶

function: Callable[[...], Any] | None¶

model_config: ClassVar[ConfigDict] = {'extra': 'forbid'}¶: Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

model_post_init(_ExecutionFunction__context: Any) → None¶

Validate that exactly one execution type is specified.

Raises:: ValueError – If zero or multiple execution types are specified
Parameters:: _ExecutionFunction__context (Any)
Return type:: None

name: str¶

class ogdc_runner.models.parallel_config.FilePartition(**data: Any) → None¶

Bases: OgdcBaseModel

Represents a partition of input files for parallel execution.

Each partition represents a unit of work executed in a separate container/task.

partition_id¶: Unique identifier for this partition

files¶: File paths or URLs to process in this partition

execution_function¶: Name of the ExecutionFunction to run

metadata¶: Additional metadata (e.g., num_files, size)

Parameters:

data (Any)
partition_id (int)
files (list[str])
execution_function (str)
metadata (dict[str, str | int | float])

execution_function: str¶

files: list[str]¶

metadata: dict[str, str | int | float]¶

model_config: ClassVar[ConfigDict] = {'extra': 'forbid'}¶: Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

partition_id: int¶