Achieving 7000 msg/s (~6.7MB/s) with just 27MB of memory on a free t3.micro EC2 in AWS

Hacker News is a community-driven platform for sharing and discussing technology news, startups, and programming-related topics. Through user submissions and comments, Hacker News offers insights into emerging technology trends, industry developments, and entrepreneurial ventures. Readers can participate in discussions, share their insights, and stay informed about the latest advancements in technology and innovation.

Hacker News

Tansu, a Kafka-compatible broker written in Rust, achieves 7000 msg/s (~6.7MB/s) throughput using only 27MB of memory on AWS's free tier t3.micro instance. The setup uses SQLite as the storage engine, making backup and restore as simple as copying a single database file. The article provides a complete walkthrough of deploying Tansu on Amazon Linux 2023 using Docker Compose, including performance benchmarks showing ~35ms average latency. The lightweight broker is designed for cost-effective project kickstarts with the ability to scale up by copying the database to larger instances.

Small Kafka: Tansu + SQLite on a free t3.micro (AWS Free Tier)