Data Modeling for Performance: Virtual Masterclass (Sponsored)

ByteByteGo provides tutorials, articles, and resources for learning and mastering the Go programming language, covering topics such as syntax, concurrency, and best practices. Developers can learn about Go programming fundamentals, web development with Go, and building scalable applications using Go's powerful features and standard library.

ByteByteGo

Notion experienced a 10-fold increase in data growth since 2021, reaching over 200 billion blocks stored in their Postgres database by 2024. This exponential growth led to the development of a new data lake infrastructure to manage the heavy load and improve scalability, performance, and cost-efficiency. The new setup includes using S3 for storage, Kafka for data ingestion, and Apache Hudi for managing updates. This overhaul has resulted in significant cost savings, reduced ingestion times, and enabled new features such as Notion AI.

Storing 200 Billion Entities: Notion’s Data Lake Project

Build client and partner portals in 30 minutes (Sponsored)

Solving Scaling Challenges of the New Data Lake