Amazon SageMaker HyperPod now supports two new instance types: G7e and r5d.16xlarge. G7e instances are powered by NVIDIA RTX PRO 6000 Blackwell Server Edition GPUs, offering up to 2.3x better inference performance than G6e, 768 GB total GPU memory, and are suited for LLM deployment, agentic AI, fine-tuning, and multimodal workloads. The r5d.16xlarge instance provides 64 vCPUs, 512 GB RAM, and 3 TB NVMe SSD storage, making it ideal for distributed training data preprocessing with frameworks like Ray, large-scale feature engineering, and memory-intensive orchestration services. G7e availability is limited to select AWS regions, while r5d.16xlarge is available in all HyperPod-supported regions.
Sort: