datasynth-runtime
| Crates.io | datasynth-runtime |
| lib.rs | datasynth-runtime |
| version | 0.2.1 |
| created_at | 2026-01-20 15:38:19.056333+00 |
| updated_at | 2026-01-24 21:50:05.941595+00 |
| description | Runtime orchestration, parallel execution, and memory management |
| homepage | |
| repository | |
| max_upload_size | |
| id | 2056870 |
| size | 306,045 |
Michael Ivertowski (mivertowski)
documentation
README
datasynth-runtime
Runtime orchestration, parallel execution, and memory management.
Overview
datasynth-runtime provides the execution layer for SyntheticData:
- GenerationOrchestrator: Coordinates the complete generation workflow
- Parallel Execution: Multi-threaded generation with Rayon
- Memory Management: Integration with memory guard for OOM prevention
- Progress Tracking: Real-time progress reporting with pause/resume
Key Components
| Component | Description |
|---|---|
GenerationOrchestrator |
Main workflow coordinator |
EnhancedOrchestrator |
Extended orchestrator with all enterprise features |
ParallelExecutor |
Thread pool management |
ProgressTracker |
Progress bars and status reporting |
Generation Workflow
- Initialize: Load configuration, validate settings
- Master Data: Generate vendors, customers, materials, assets
- Opening Balances: Create coherent opening balance sheet
- Transactions: Generate journal entries with document flows
- Period Close: Run monthly/quarterly/annual close processes
- Anomalies: Inject configured anomalies and data quality issues
- Export: Write outputs and generate ML labels
Usage
use datasynth_runtime::GenerationOrchestrator;
let orchestrator = GenerationOrchestrator::new(config)?;
// Full generation
orchestrator.run()?;
// With progress callback
orchestrator.run_with_progress(|progress| {
println!("Generated: {}/{}", progress.completed, progress.total);
})?;
Pause/Resume
On Unix systems, send SIGUSR1 to toggle pause:
kill -USR1 $(pgrep datasynth-data)
License
Apache-2.0 - See LICENSE for details.