Bifrost - The fastest LLM gateway in the market

Bifrost is an open-source LLM gateway written in Go that claims to be 40x faster than LiteLLM with only 11μs overhead at 5,000 RPS. It supports 1000+ models across providers through a single API, features built-in Model Context Protocol (MCP) support, plugin architecture, and API key management with weighted distribution. The gateway integrates with Maxim for observability and evaluation capabilities, targeting AI teams needing high-performance model routing at scale.