LY Corporation (LINE + Yahoo! Japan) uses ClickHouse to monitor one of the world's largest Kafka deployments, processing over 1 trillion messages and 2.6 PB daily. With just 24 servers, ClickHouse ingests 7 million rows per second of Kafka API request logs, storing over 4.1 trillion rows. This observability stack enabled
Table of contents
A Kafka deployment like no other #LY’s multi-layer observability stack #Why they chose ClickHouse #Catching a Kafka bug in production #Why ClickHouse matters at LY’s scale #Sort: