Relay is a self-hostable LLM chat environment distributed as a RubyGem, designed to be set up in under two minutes. It supports multiple AI providers (OpenAI, Anthropic, DeepSeek, xAI, Google) and MCP servers via HTTP and stdio. Built on Roda, Sequel, Falcon, HTMX, and SQLite3, it allows users to extend functionality with custom Ruby tools placed in ~/.relay/tools. The author recommends DeepSeek for cost-effectiveness, noting a 1M context window costs roughly 14 cents.
Table of contents
AboutGetting startedFeaturesSounds cool, how does it look?How easy is it to setup?How do I add my own tool?Wait, what is a tool?What are the default tools?What provider is the best value?What about Ollama and friends?SourcesLicenseSort: