You can now ingest data from Google Cloud Storage into ClickHouse Cloud in any order for event-driven, blazing-fast analytics.

ClickHouse is a leading platform for open-source columnar database technology and real-time analytics. With ClickHouse, developers can delve into documentation, case studies, and performance benchmarks to learn how to build highly scalable and performant analytical systems. It provides tips about ClickHouse's storage engine, query execution, and distributed architecture. Developers can gain insights into their data in real-time, enabling them to make informed decisions and extract  business insights.

ClickHouse

ClickHouse Cloud's GCS ClickPipes now supports unordered mode, allowing data ingestion from Google Cloud Storage without requiring files to arrive in lexicographical order. Instead of polling the bucket every 30 seconds, the connector listens for Pub/Sub OBJECT_FINALIZE notifications and processes files as they land, regardless of naming order. This handles backfills, retries, and late-arriving data while maintaining exactly-once semantics to prevent duplicates. Setup requires configuring a Pub/Sub topic, a service account with appropriate IAM permissions, and enabling the 'Any order ingestion mode' in the ClickHouse Cloud console. The feature is also available for Amazon S3, with Azure Blob Storage support planned.

Unordered mode for GCS ClickPipes is now available