Tesla built Comet, a quadrillion-scale observability platform using ClickHouse as the foundation, replacing Prometheus due to scalability limitations. The system ingests tens of millions of rows per second through a Kafka-based pipeline and uses a custom transpiler to convert PromQL queries to ClickHouse SQL in real-time. During testing, Comet successfully ingested over one quadrillion rows at one billion rows per second for 11 days without issues, demonstrating exceptional performance and reliability for enterprise-scale metrics storage and analysis.
Table of contents
A slew of non-negotiablesThe case for ClickHouseInside Comet’s architectureProving the system at scaleWhat’s next for Tesla and ClickHouseSort: