FastChat logo

FastChat

lm-sys/FastChat

An open platform for training, serving, and evaluating large language models

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

81views this month

40k stars4.8k forksLast push May 1, 2026 Python Apache-2.0

Decision brief

FastChat is an open-source platform for training, serving, and evaluating large language models, including Vicuna, and supports Chatbot Arena, a platform for LLM evaluations with human feedback.

Good fit when

  • When you need a platform that supports both training and evaluation of large language models, such as Vicuna, and you want to leverage human feedback for model evaluation.
  • If you require a distributed multi-model serving system with a web UI and OpenAI-compatible RESTful APIs for deploying and serving multiple LLMs.

Avoid when

  • If you are looking for a platform that focuses solely on model training without serving or evaluation capabilities, FastChat offers a comprehensive suite that might be more than you need.
  • If your project does not require human feedback for model evaluation, FastChat's integration with Chatbot Arena might be an unnecessary feature.

Observed Sep 18, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Slowing (140d since push)
As of Sep 18, 2026
Provenance
Not a fork · Organization account
As of Sep 18, 2026
Security (OSV)
No lockfile
As of Sep 18, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install FastChat
PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

FastChat is an open-source platform for training, serving, and evaluating large language models, including Vicuna and supporting Chatbot Arena, a platform for LLM evaluations with human feedback.

Capability facts

Languages
python

Source: github.language+pyproject.toml · Sep 18, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Sep 18, 2026)

| 7B | `python3 -m fastchat.serve.cli --model-path lmsys/vicuna-7b-v1.5` | [lmsys/vicuna-7b-v1
Source link
Works with ChatGPTChatGPT

Source: README excerpt (regex_v1, Sep 18, 2026)

2023/03] We released **Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90% ChatGPT Quality**. Check out the blog [post](https://vicuna.lmsys.org).
Source link

Tags

README

FastChat Demo Discord X FastChat is an open platform for training, serving, and evaluating large language model based chatbots. FastChat powers Chatbot Arena (lmarena.ai), serving over 10 million chat requests for 70+ LLMs. Chatbot Arena has collected over 1.5M human votes from s...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.