Amazon Bedrock now supports batch inference, allowing users to process prompts in batches for model evaluation, experimentation, and offline processing. Batch processing improves efficiency and enables the aggregation and analysis of responses.
Sort: