Discover more about what's new at AWS with Amazon Bedrock now supports observability of First Token Latency and Quota Consumption

AWS' platform is a leading cloud computing platform, offering insights into cloud infrastructure, services, and solutions for developers, businesses, and IT professionals. Through articles, whitepapers, and documentation, AWS offers insights into cloud architecture, serverless computing, and machine learning on AWS. Developers and architects can learn about AWS services like EC2, S3, Lambda, and more to build scalable, secure, and cost-effective cloud applications.

Amazon Bedrock now provides two new CloudWatch metrics for improved inference observability. TimeToFirstToken measures streaming API latency from request to first token received, enabling SLA monitoring and latency alarms without client-side instrumentation. EstimatedTPMQuotaUsage tracks Tokens Per Minute quota consumption including cache write tokens and output burndown multipliers across all inference APIs, allowing proactive quota management before rate limiting occurs. Both metrics are available in all commercial Bedrock regions, updated every minute, with no opt-in or API changes required.