Portkey is open sourcing its Production Gateway, previously available only as a SaaS product. The gateway acts as a unified layer for all AI requests, supporting 250+ LLMs with fallbacks, load balancing, retries, and guardrails. New additions include an MCP Registry for managing and versioning MCP servers, OAuth 2.1 with PKCE for MCP authentication, configurable circuit breakers, usage policies enforced at ingress, a model catalog with pricing, and real-time metrics. An on-prem enterprise tier adds gRPC, SSO, SCIM, AWS KMS, RBAC, and compliance certifications. The release is framed around the shift from simple prompt-response AI to complex agentic workflows that require production-grade infrastructure.
Table of contents
It used to be simple...What's new in the OSS Production Gateway?All of it. Open source.1 Comment
Sort: