QuestDB

QuestDB is an open-source time-series database with SQL analytics designed to efficiently handle data ingestion and analysis. The post details the development and debugging of a primary-replica replication feature, addressing a performance issue related to excessive network bandwidth usage. The author implemented a custom network profiling tool using Rust to capture and analyze network traffic, identifying the root cause of the problem. The solution involved optimizing how metadata was uploaded, ultimately improving bandwidth efficiency. Techniques used within QuestDB for high ingestion performance were also highlighted.