vLLM

open-webui

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs

unsloth

A web UI for training and running open models locally.

litellm

Python SDK and Proxy Server for calling multiple LLM APIs

LocalAI

Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

CodeWhale

Open-source, community-driven agent harness

happy-llm

📚 From Zero to Building Large Models

onyx

Open Source AI Platform - AI Chat with advanced features that works with every LLM

agent-lightning

The absolute trainer to light up AI agents

Llama-Chinese

Llama中文社区，实时汇总最新Llama学习资料，构建最好的中文Llama大模型开源生态

text-generation-inference

Large Language Model Text Generation Inference

OpenRLHF

Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray

Chinese-LLaMA-Alpaca-2

Chinese LLaMA-2 & Alpaca-2 models with extended context lengths

UltraRAG

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

cube-studio

一站式机器学习/深度学习/AI开发平台

align-anything

Training All-modality Model with Feedback

AIGC-Interview-Book

Three Years of Interviews Five Years of Practice The Ultimate Guide to AIGC Interview LLMs Interview AI Agent Interview Deep Learning Interview Algorithm Engineer Interview

FlashRAG

A Python toolkit for efficient RAG research

Ask-Anything

ChatGPT with enhanced video understanding capabilities

lmnr

Open-source observability platform for AI agents.

cube-studio

一站式云原生机器学习/深度学习平台

aici

Builds Controllers for Constrained LLM Output in Real-time Using Wasm

rtp-llm

Alibaba's high-performance LLM inference engine for diverse applications.

prometheus-eval

Evaluate your LLM's response with Prometheus and GPT4