LocalAI vs PowerInfer
A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.
| LocalAI | PowerInfer | |
|---|---|---|
| Tagline | LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. | High-speed Large Language Model Serving for Local Deployment |
| Stars | 47k | 9.6k |
| Forks | 4.2k | 585 |
| Open issues | 208 | 129 |
| Language | Go | C++ |
| License | MIT | MIT |
| Last pushed | Jul 7, 2026 | May 11, 2026 |
| Categories | Inference & Serving, LLM Frameworks, AI Agents | Inference & Serving, LLM Frameworks |
LocalAI
A composable and extensible tool allowing for the execution of various machine learning models without requiring advanced graphics hardware.
Go
PowerInfer
PowerInfer is a CPU/GPU LLM inference engine that utilizes activation locality to optimize performance on consumer-grade GPUs and CPUs.
C++