A Cloudflare engineer presents the challenge of exposing large APIs (2,600+ endpoints) to AI agents via MCP without exploding context windows. Three approaches are compared: CLI-based tool access, keyword-based tool search, and letting agents write code against typed SDKs. The talk advocates for programmatic tool calling using isolated sandboxes (Cloudflare Workers, Deno, Pydantic) to safely execute LLM-generated code. A live demo shows an MCP client accessing the entire Cloudflare API via dynamically generated code. The speaker predicts MCP will become lightweight middleware baked into major TypeScript frameworks, and that AI agents writing code against APIs will become the dominant interaction pattern.
•22m watch time
Sort: