AI Gateway now gives you the choice to sort providers behind a model by cost, time to first token, or throughput, so each request routes to the provider that fits your priorities.

Vercel is a platform for deploying modern web applications with speed and simplicity, offering developers a seamless experience for hosting and scaling their projects. With features like instant deployment, serverless functions, and global CDN, Vercel empowers developers to focus on building great user experiences without worrying about infrastructure management.

Vercel

Vercel AI Gateway now supports a `sort` option on `providerOptions.gateway` that lets you rank providers behind a model by cost, time to first token (TTFT), or throughput (TPS). Sorting is computed at request time, so price changes and latency shifts are reflected automatically. The feature composes with other routing controls like Zero Data Retention and manual `order` overrides. Every response also includes routing metadata showing which providers were considered, their metric values, the execution order, and any deprioritized providers.

Sort providers by cost, latency, or throughput on AI Gateway