Boost AI/ML performance on Google Cloud with the new Rapid Storage integration for PyTorch. Learn how bidirectional gRPC streaming and Colossus architecture can increase training speeds by 23% and deliver 15+ TiB/s throughput with zero code changes.

GoogleDevs' platform is a central hub for developers interested in Google technologies, APIs, and developer tools. Through articles, tutorials, and documentation, GoogleDevs offers insights into building applications using Google Cloud Platform, Android, Chrome, and other Google services. Developers can learn about cloud computing, machine learning, and mobile app development with Google's developer tools and platforms.

Google Developers

Google is announcing Rapid Bucket, a high-performance object storage solution for Google Cloud that integrates with PyTorch via the gcsfs fsspec interface. By replacing REST-based storage access with persistent bidirectional gRPC streams backed by Google's Colossus architecture, it delivers a 23% training speed improvement and 4.8x read throughput gains. The integration requires zero code changes — developers only need to switch to a Rapid Bucket and upgrade gcsfs to version 2026.3.0. Benchmarks were run on 16 GKE nodes with A4 GPUs using PyTorch Lightning across 134M rows of data.

Speeding Up AI: Bringing Google Colossus to PyTorch via GCSFS and Rapid Bucket

Rapid Bucket: Rapid Storage via bi-di gRPC

Fsspec - PyTorch’s Pythonic file interface