mlc-ai/web-llm: Bringing large-language models and chat to web browsers. Everything runs inside the browser with no server support.

WebLLM is a javascript package that brings language model chats directly to web browsers with hardware acceleration and no server support. It is compatible with OpenAI API and offers streaming, json-mode, function-calling, and seed-to-reproduce functionalities.