ogdc_runner.partition_manifests module

ogdc_runner.partition_manifests.make_partition_manifest_writer_template(*, name: str, recipe_id: str, manifest_subdir: str, partitions: Sequence[dict[str, Any]], workflow_volume_name: str, image: str | None = None) → hera.workflows.Container

Create a setup template that writes partition manifests to the PVC.

The output parameter intentionally contains only partition IDs. Full file lists remain on the workflow PVC after workflow completion for provenance.

Parameters:
Return type:

Container

ogdc_runner.partition_manifests.manifest_inputs(manifest_param: str, manifest_path_param: str) → list[hera.workflows.Parameter]

Return compatible inline/path manifest inputs for worker templates.

Existing URL/DataONE flows can still pass inline JSON, while scalable PVC flows pass a small path parameter pointing at a manifest stored on the workflow PVC.

Parameters:

  • manifest_param (str)

  • manifest_path_param (str)

Return type:

list[Parameter]

ogdc_runner.partition_manifests.partition_manifest_inputs() → list[hera.workflows.Parameter]
Return type:

list[Parameter]

ogdc_runner.partition_manifests.partition_manifest_path(recipe_id: str, partition_id: int | str, *parts: str) → str

Return a concrete partition manifest path on the workflow PVC.

Parameters:
Return type:

str

ogdc_runner.partition_manifests.partition_manifest_path_arg(recipe_id: str, *parts: str) → str

Return a partition manifest path containing Argo’s item partition ID.

Parameters:
Return type:

str

ogdc_runner.partition_manifests.partition_manifest_records(partitions: Sequence[Any]) → list[dict[str, Any]]

Convert FilePartition-like objects to JSON-serializable manifest records.

Parameters:

partitions (Sequence[Any])

Return type:

list[dict[str, Any]]

ogdc_runner.partition_manifests.workflow_manifest_dir(recipe_id: str, *parts: str) → str

Return the workflow PVC directory used for partition manifests.

Parameters:
Return type:

str