FastChat is an open platform for training, serving, and evaluating large language model based chatbots. It powers Chatbot Arena, a platform for LLM battles and has released several models such as Vicuna and LongChat. The repo provides instructions on installation, model weights, inference, serving, evaluation, and more.

10m read timeFrom github.com
Post cover image
Table of contents
NewsContentsInstallModel WeightsInference with Command Line InterfaceServing with Web GUIAPIEvaluationFine-tuningCitation

Sort: