ogdc_runner.workflow.shell module

class ogdc_runner.workflow.shell.ShellParallelExecutionOrchestrator(recipe_config: RecipeConfig, execution_function: ExecutionFunction) → None

Bases: ParallelExecutionOrchestrator

Orchestrator for parallel execution of shell-based workflows.

This class implements the ParallelExecutionOrchestrator interface specifically for shell command workflows. It handles:

  1. Creating Container templates with shell command execution

  2. Building partition processing scripts

  3. Creating tasks with shell-specific parameters

Parameters:
create_execution_template() → Container | Any

Create Argo Container template for shell command execution.

Return type:

Container | Any

Returns:

Container template configured for parallel partition processing

Raises:

ValueError – If execution function has no valid execution type

ogdc_runner.workflow.shell.make_and_submit_shell_workflow(recipe_config: RecipeConfig, wait: bool) → str

Create and submit an argo workflow based on a shell recipe.

Parameters:

  • recipe_config (RecipeConfig) – Recipe configuration containing workflow details

  • wait (bool) – Whether to wait for workflow completion

Return type:

str

Returns:

Workflow name

ogdc_runner.workflow.shell.make_cmd_template(name: str, command: str) → hera.workflows.Container

Creates a command template with an optional custom image.

Parameters:

  • name (str) – Name of the template

  • command (str) – Shell command to execute

Return type:

Container

Returns:

Container template