unknown

Bifrost is an open-source AI gateway written in Go that provides unified access to 15+ LLM providers through a single OpenAI-compatible API. It features automatic failover, adaptive load balancing, semantic caching, and adds only 11 microseconds of overhead at 5,000 RPS. The gateway supports 1000+ models, includes a web UI for configuration, offers enterprise features like budget management and SSO, and can be deployed via NPX, Docker, or as a Go SDK. It serves as a drop-in replacement for OpenAI, Anthropic, and other provider APIs with zero code changes.

maximhq/bifrost: Fastest LLM gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

🚀 Daily Open Source Tools Squad delivers daily articles, open-source projects, and technical resources for Developers & DevOps pros. Stay updated with the latest trends & insights!

📬 Join our mailing list! → theinfinity.dev

Daily Open Source Tools

Bifrost: Fastest LLM gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

<p>Bifrost: Fastest LLM gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support &amp; &lt;100 µs overhead at 5k RPS.</p>