Portkey open sources its AI Gateway and MCP Gateway, bringing governance, observability, and cost controls to enterprises running AI at trillion-token scale.

The New Stack is a publication covering trends and technologies in cloud-native development, DevOps, and software delivery. Developers can learn about containerization, Kubernetes, and cloud computing, as well as explore topics such as microservices architecture, serverless computing, and continuous integration/continuous delivery (CI/CD) pipelines.

The New Stack

Portkey has open-sourced its AI Gateway and MCP Gateway, which together form a control plane for managing AI model traffic, enforcing governance policies, and controlling costs in production environments. The platform already processes 2 trillion tokens per day across 24,000 organizations. The open-source release includes usage policy controls, a model catalog, real-time metrics, an MCP registry, and OAuth 2.1/2.0 authentication for MCP traffic. The CEO argues that foundational AI infrastructure like governance and observability should be freely available rather than locked behind SaaS contracts, with commercial value built on top. The MCP Gateway specifically addresses enterprise concerns about governing AI agents that can take real actions inside enterprise systems.

Portkey open-sources its AI gateway after processing 2 trillion tokens a day