Datadog built Monocle, a custom time-series database in Rust, to handle billions of metrics per second. The system uses Kafka for data distribution and replication, separates metadata storage from time-series data, and employs a thread-per-core architecture with LSM-tree storage. Key optimizations include arena allocators,

12m read timeFrom blog.bytebytego.com
Post cover image
Table of contents
Build a more sustainable on-call experience (Sponsored)Move faster with AI: Write code you can trust (Sponsored)High-Level Metrics Platform ArchitectureUsing KafkaMonocle: The Custom Built Engine in RustStaying Fast Under PressureConclusionSPONSOR US

Sort: