Orchestration

Multi-step workflow orchestration for CDM pipelines

IngestCompleted3.2s
Load trade data from source system
In: CSV file (1,247 records)Out: Raw trade objects
ValidateCompleted1.8s
Validate against CDM schema and business rules
In: Raw trade objectsOut: 1,235 valid, 12 rejected
TransformCompleted4.1s
Transform to CDM canonical format
In: 1,235 validated recordsOut: CDM trade objects
4
EnrichRunning2.6s...
Enrich with reference data (LEI, ISIN, counterparties)
In: CDM trade objectsOut: Enriched CDM objects (in progress)
5
ReportPending
Generate regulatory reports (EMIR, MiFID II)
In: Enriched CDM objectsOut: Report submissions
6
ArchivePending
Archive to data lake with full audit trail
In: Final CDM objects + reportsOut: Archived records
Execution Log
14:32:01.123[INFO ]Workflow "Trade Lifecycle" started
14:32:01.456[INFO ]Step 1/6: Ingest — loading trade_portfolio_2026Q1.csv
14:32:04.678[SUCCESS]Ingest complete: 1,247 records loaded in 3.2s
14:32:04.701[INFO ]Step 2/6: Validate — running CDM schema validation
14:32:05.892[WARN ]Validation: 12 records failed LEI format check
14:32:06.503[SUCCESS]Validate complete: 1,235 passed, 12 rejected in 1.8s
14:32:06.510[INFO ]Step 3/6: Transform — mapping to CDM canonical model
14:32:10.612[SUCCESS]Transform complete: 1,235 CDM objects generated in 4.1s
14:32:10.620[INFO ]Step 4/6: Enrich — resolving LEI, ISIN, party data...
14:32:12.801[INFO ]Enrich: 847/1,235 records enriched...