ggml vs LocalAI
A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.
| ggml | LocalAI | |
|---|---|---|
| Tagline | Tensor library for machine learning | LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. |
| Stars | 15k | 47k |
| Forks | 1.7k | 4.2k |
| Open issues | 340 | 208 |
| Language | C++ | Go |
| License | MIT | MIT |
| Last pushed | Jun 26, 2026 | Jul 7, 2026 |
| Categories | Model Training, LLM Frameworks | Inference & Serving, AI Agents, LLM Frameworks |
ggml
ggml is a tensor library tailored for machine learning, supporting automatic differentiation and various optimizers. It includes integer quantization support, broad hardware compatibility, and is designed without third-party dependencies.
C++
LocalAI
A composable and extensible tool allowing for the execution of various machine learning models without requiring advanced graphics hardware.
Go