The Uber Engineering Blog offers insights, technical deep dives, and updates on the engineering challenges and solutions behind Uber's platform and services. Covering topics such as distributed systems, data infrastructure, and mobile development, the blog provides resources for developers interested in large-scale systems and real-world engineering problems. Developers can learn about Uber's technology stack, engineering culture, and best practices for building scalable and reliable systems.

Uber Engineering

Uber has developed a new algorithm to optimize the HDFS balancer, increasing data balance and throughput in their large-scale data storage clusters. The algorithm focuses on increasing the number of DataNode pairs, prioritizing smaller occupied DataNodes, and improving observability. As a result, the throughput increased by more than 5x, highly utilized DataNodes were brought down to 0%, overall usage of DataNodes was reduced, and cluster utilization improved.

uber-sites