Developers can significantly increase throughput and reduce token usage with the new updates to the Anthropic API, including cache-aware rate limits, simpler prompt caching, and token-efficient tool use. These enhancements, available with Claude 3.7 Sonnet, help store and reuse frequently accessed context, optimize prompt caching, and introduce new tools like text_editor for efficient document editing.
Table of contents
Increase your throughput with prompt cachingToken-efficient tool useCustomer Spotlight: CognitionGet started nowSort: