GitHub - aws/deep-learning-containers: One stop shop for running AI/ML on AWS.
AWS Deep Learning Containers (DLCs) are pre-built, security-patched Docker images for running AI/ML workloads on AWS services like EC2 and SageMaker. Recent releases include vLLM v0.21.0 and SGLang v0.5.12 with support for models like DeepSeek V4, Gemma 4, and Qwen 3.4. PyTorch 2.11.0 is now available with CUDA 13.0 and Amazon Linux 2023. A notable support update warns that Ubuntu-based images will no longer receive guaranteed security patches, with migration to Amazon Linux-based images recommended. Resources include tutorials for distributed training on EKS, LLM serving with vLLM, and fine-tuning Llama 3.2 Vision.