Data Flow Diagrams
Interactive visualizations of the Atlas data pipeline
Complete Pipeline Overview
End-to-end data flow from suppliers through Bronze/Silver/Gold layers to distribution
Loading diagram renderer...
📖 Legend
Services & Workers
Storage Systems
Kafka Topics & Events
Valid/Success Paths
Error/Failure Paths
Scaling/Optional Paths
Pipeline Layers
4
Raw → Bronze → Silver → Gold
Worker Types
3
Bronze, Silver, Gold
Kafka Topics
5
Event-driven architecture
Cache Hit Rate
99%
Redis AI enrichment cache
Complete Documentation
See
/docs/DATA_FLOW_DIAGRAMS.md for 12+ detailed diagrams including:
Image deduplication, Translation flow, Error handling, Performance metrics, and more