Result neighbourhood
Top matches for your query, linked as a graph hub. Follow any node to drill in.
LLM inference in C/C++
The easiest way to serve AI apps and models
RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
Self-Hosting LLMs Made Easy
End-to-end framework for building custom AI applications and agents.
Repository listing free and trial-based LLM inference API resources
Unified framework for scaling AI and Python applications
Find secrets with Gitleaks
分享大模型技术原理与实战经验，涵盖工程化和应用落地
High-speed Large Language Model Serving for Local Deployment
Artificial Intelligence Controller Interface (AICI)
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
AI-native proxy server and data plane for agentic apps
OptiLLM is an OpenAI API-compatible optimizing inference proxy that enhances LLM accuracy and performance on reasoning tasks without needing to train or fine-tune models.
20+ high-performance LLMs with recipes to pretrain, finetune, and deploy at scale.
Community maintained hardware plugin for vLLM on Ascend
Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
Neuron is an Agentic Framework in PHP for building production-ready AI driven applications.
Simple, Explicit and Transparent LLM Applications
SGLang high-performance serving framework
A high-throughput and memory-efficient inference and serving engine for LLMs
Machine Learning Engineering Open Book
A generative speech model for daily dialogue
Implement a reasoning LLM in PyTorch from scratch, step by step
Repository for running large language models with reduced memory usage on limited GPU hardware.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice
VectorHub: A Learning Hub for Vector Retrieval in ML
Summary of the world's best LLM resources.
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models
An Open Bilingual Chat LLM
Postgres with GPUs for ML/AI applications.
Universal LLM Deployment Engine with ML Compilation