AI workloads demand new infrastructure. Key focus areas include 102.4Tbps networking, co-packaged optics, scale-across, optimized storage, and robust security.

Cisco's platform provides networking knowledge, offering  guides, tutorials, and case studies on networking technologies, cybersecurity, and collaboration tools. Whether you're a networking novice looking to understand the basics of routing and switching or a seasoned IT professional seeking advanced insights into network architecture and security protocols, Cisco has resources tailored to your needs. Dive into Cisco's extensive library of resources to sharpen your networking skills and stay ahead in the rapidly evolving world of IT infrastructure.

Cisco

AI workloads are pushing infrastructure beyond its limits, requiring a fundamental rebuild rather than incremental optimization. Key areas covered include the shift to 102.4Tbps networking silicon as the new baseline for AI clusters, the rise of Linear-drive Pluggable Optics (LPO) and Co-Packaged Optics (CPO) to address power and bandwidth constraints, and the emerging 'scale-across' paradigm that treats compute across multiple geographic locations as a single pool. Storage is identified as an underappreciated bottleneck, with KV caches, checkpoint writes, and data ingestion all capable of idling expensive GPUs. Security challenges unique to AI—including model weight theft, adversarial inputs, and training data poisoning—demand hardware-rooted trust, confidential computing, and DPU-based network enforcement. Organizations that invest in all these layers together, not just GPUs, will be positioned to train and deploy next-generation AI systems.

Rebuilding The Foundation: Why AI Infrastructure Needs To Change

The bandwidth wall and the rise of co-packaged optics

Dive deeper into the announcements we made this week at GTC.