Confidential VMs are now available with built-in CPU acceleration with Intel AMX. Which one is suited for AI? Check out our test results.

Google Cloud Platform provides a suite of cloud computing services for building, deploying, and managing applications and infrastructure on Google's global network. Developers can learn about cloud-native development, machine learning, and big data analytics to leverage GCP's scalable and reliable cloud infrastructure for their projects.

Google Cloud

Google Cloud has integrated Intel's AMX accelerator into its latest C3 Confidential VMs to enhance deep-learning training and inference performance. These VMs also feature Intel Trust Domain Extensions (Intel TDX) for heightened security. Experiments show significant speedups in training and inference tasks on C3 VMs with Intel AMX and TDX, despite some performance overhead with TDX. Users can leverage these technologies for improved security and performance in AI workloads.

We tested Intel’s AMX CPU accelerator for AI. Here’s what we learned

Performance testing AI/ML workloads on Confidential VMs