We built a standalone MCP server in Python, then rewrote it in Java for full Vespa integration — and lived to tell the tale.

Vespa Blog

Two interns built an MCP (Model Context Protocol) server for Vespa, starting with a Python prototype using PyVespa and the MCP SDK, then rewrote it in Java for full container integration. The server enables LLMs to query Vespa applications using natural language through three main tools: schema retrieval, documentation search, and query execution. Key challenges included implementing custom request handlers, managing stateless communication across distributed nodes, and adapting to frequent MCP SDK updates. The final implementation runs as a Vespa component with HTTP transport, providing read-only access to applications both locally and in the cloud.

LLMs, Vespa, and a side of Summer Debugging

The Real Challenge: Container Integration