Reference: Pipeline Runtime

PipelineContext

Official import: from library.core import PipelineContext

The immutable component holder for one run. It validates required components, normalizes collections to tuples, and stores source_config for reproducible exports.

Pipeline

Official import: from library.core import Pipeline

outputs = Pipeline(context, pipeline_id="run-id").run()

Runs an already-built context and returns PipelineOutputs.

ConfigPipelineBuilder

Official import: from library.core import ConfigPipelineBuilder

context = ConfigPipelineBuilder(registry).build_context(config)

Normalizes config version, resolves plugins, validates params, and returns a PipelineContext.

PipelineOrchestrator

Official import: from library.core.pipeline import PipelineOrchestrator

Application facade for sync and async execution.

ThreadedPipelineRunner

Official import: from library.core.pipeline import ThreadedPipelineRunner

Default runner implementation based on worker threads, retry policy, monitor, and output store.

Execution Plan

Official import: from library.core.pipeline import PipelineExecutionPlan

The execution plan records stage decisions, streamability, materialization boundaries, and reasons generated by the execution policy.

Runtime Config

Official import: from library.core.pipeline import StreamRuntimeConfig

Controls bounded buffers and frame latency policy.