Learn how Laravel Nightwatch platform process billions of observability events in real time while keeping query latency under a second.

ClickHouse is a leading platform for open-source columnar database technology and real-time analytics. With ClickHouse, developers can delve into documentation, case studies, and performance benchmarks to learn how to build highly scalable and performant analytical systems. It provides tips about ClickHouse's storage engine, query execution, and distributed architecture. Developers can gain insights into their data in real-time, enabling them to make informed decisions and extract  business insights.

ClickHouse

Laravel Nightwatch processes over 1 billion observability events daily using Amazon MSK and ClickHouse Cloud. The platform combines MSK Express brokers for event ingestion, ClickPipes for streaming data to ClickHouse, and AWS Lambda for validation. This architecture achieves sub-second query latency while handling millions of events per second. On launch day, the system processed 500 million events with 97ms average dashboard latency for 5,300 users. The dual-database design separates transactional workloads on RDS PostgreSQL from analytical workloads on ClickHouse Cloud, enabling horizontal scaling and cost-effective real-time monitoring at global scale.

Inside Laravel Nightwatch’s Observability Pipeline: Real-Time Event Processing with Amazon MSK and ClickHouse Cloud

The challenge: Delivering real-time monitoring for a global developer community #

The solution: A decoupled streaming and analytics pipeline #

<p>I like how elegant this solution looks on paper! I’d say even boring to a degree. Good job!</p>
