Data science
vrv's profile
Vrushank Vyas@vrv•Jan 25, 2024
260
Post cover image

Portkey-AI/gateway: A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.

Avatar of communityCommunity Picks•From github.com•Jan 22, 2024•1m read time

Portkey-AI/gateway is a blazing fast AI gateway that allows for streamlined API requests to multiple Language Model APIs. It offers features such as fast performance, load balancing, fallbacks, automatic retries, and middleware support. The AI Gateway can be configured with versatile routing strategies. It supports various SDKs and can be deployed locally or on popular platforms. The roadmap includes plans for supporting more providers, enhancing load balancing features, improving fallback and retry strategies, and increasing customizability of the unified API signature.

4 Comments

Sort:

vrv's user avatar
Vrushank Vyas
@vrv
Joined Sep 9. 2023
260

Would you recommend this post?

Copy link
WhatsApp
Facebook
X
New Squad
  • © 2026 Daily Dev Ltd.
  • Guidelines
  • Explore
  • Tags
  • Sources
  • Squads
  • Leaderboard