GoModel is an open-source, high-performance AI gateway written in Go that provides a unified OpenAI-compatible API across multiple LLM providers including OpenAI, Anthropic, Gemini, Groq, xAI, Azure OpenAI, Oracle, Ollama, and more. It supports chat completions, embeddings, file management, batch processing, and provider-native passthrough routes. Key features include a two-layer response cache (exact-match and semantic via vector search), Prometheus metrics, audit logging, guardrails, and an admin dashboard. Deployable via Docker with environment variable configuration, it supports SQLite, PostgreSQL, and MongoDB as storage backends. Positioned as a LiteLLM alternative with broader observability and caching capabilities.
Table of contents
Quick Start - Deploy the AI GatewayAlternative Setup MethodsOpenAI-Compatible API EndpointsGateway ConfigurationResponse CachingCommunityStar HistorySort: