Redpanda and Snowflake Streaming achieved 14.5 GB/s throughput with 7.5 second P99 latency when streaming 3.8 billion messages. The benchmark used a 9-node Redpanda cluster and 12 Redpanda Connect nodes to ingest data into Snowflake, exceeding Snowflake's documented 10 GB/s single-table limit by 45%. Key optimizations included

7m read time From redpanda.com
Post cover image
Table of contents
Why Redpanda Connect + Snowflake Streaming? #Setting up the end–to-end pipeline #Finding the sweet spot = blazing-fast speed at massive scale #Key tuning insights #Power real-time analytics at the speed of Redpanda #

Sort: