Discover more about what's new at AWS with Amazon SageMaker HyperPod now supports continuous provisioning for Slurm-orchestrated clusters

AWS' platform is a leading cloud computing platform, offering insights into cloud infrastructure, services, and solutions for developers, businesses, and IT professionals. Through articles, whitepapers, and documentation, AWS offers insights into cloud architecture, serverless computing, and machine learning on AWS. Developers and architects can learn about AWS services like EC2, S3, Lambda, and more to build scalable, secure, and cost-effective cloud applications.

Amazon SageMaker HyperPod now supports continuous provisioning for Slurm-orchestrated clusters. Previously, if any instance group failed to provision, the entire cluster creation or scaling operation rolled back. With continuous provisioning, HyperPod automatically provisions remaining capacity in the background while training jobs can start immediately on available instances. The system uses priority-based provisioning (controller node first, then login and worker nodes in parallel), retries failed node launches asynchronously, and supports concurrent non-blocking scaling across multiple instance groups. The feature is enabled via the NodeProvisioningMode parameter set to 'Continuous' in the CreateCluster API, AWS CLI, or SageMaker console, and is available in all regions where HyperPod is supported.