Portkey-AI/gateway is a blazing fast AI gateway that allows for streamlined API requests to multiple Language Model APIs. It offers features such as fast performance, load balancing, fallbacks, automatic retries, and middleware support. The AI Gateway can be configured with versatile routing strategies. It supports various SDKs and can be deployed locally or on popular platforms. The roadmap includes plans for supporting more providers, enhancing load balancing features, improving fallback and retry strategies, and increasing customizability of the unified API signature.

1m read timeFrom github.com
Post cover image
8 Comments

Sort: