When a company grows rapidly, its technical systems are often pushed to their limits.

ByteByteGo provides tutorials, articles, and resources for learning and mastering the Go programming language, covering topics such as syntax, concurrency, and best practices. Developers can learn about Go programming fundamentals, web development with Go, and building scalable applications using Go's powerful features and standard library.

ByteByteGo

Nubank built an in-house logging platform to replace a costly third-party vendor, handling 1 trillion daily log entries at 50% lower cost. The solution uses a two-phase architecture: an ingestion pipeline with Fluent Bit, custom buffering, and processing services, plus a query/storage layer combining Trino, AWS S3, and Parquet format. The platform processes 1 petabyte daily, maintains 45 petabytes of searchable data with 45-day retention, and serves 15,000 queries daily scanning 150 petabytes. Key design decisions included decoupling ingestion from querying, implementing micro-batching for reliability, and achieving 95% data compression with Parquet.

How Nubank Built an In-house Logging Platform for 1 Trillion Log Entries

Crane Worldwide Logistics Joins Streamfest 2025 — Hear Their Story (Sponsored)