Discover more about what's new at AWS with Amazon SageMaker AI now supports OpenAI-compatible APIs for inference endpoints

AWS' platform is a leading cloud computing platform, offering insights into cloud infrastructure, services, and solutions for developers, businesses, and IT professionals. Through articles, whitepapers, and documentation, AWS offers insights into cloud architecture, serverless computing, and machine learning on AWS. Developers and architects can learn about AWS services like EC2, S3, Lambda, and more to build scalable, secure, and cost-effective cloud applications.

Amazon SageMaker Inference now supports OpenAI-compatible APIs, allowing developers to connect existing tools like the OpenAI SDK, LangChain, and Strands Agents directly to SageMaker endpoints by simply changing the endpoint URL. No custom integration code or SDK rewrites are needed. The feature preserves existing streaming logic and framework integrations while giving users control over GPU instances, VPC data residency, open source or fine-tuned models, and auto-scaling. Authentication uses existing AWS credentials. Available now across 14 AWS regions.