Livellm is a small open-source Phoenix LiveView chat app serving as a reference implementation for integrating llm_composer into an Elixir application. It demonstrates streaming LLM output into LiveView in real time, switching between multiple LLM providers via a unified API, handling reasoning output separately, tracking token usage and cost, and persisting chat state with SQLite. The project uses OTP patterns, PubSub for streaming updates, and background tasks for non-blocking requests, showcasing how Elixir and Phoenix naturally fit LLM-powered chat use cases.
Sort: