anything-llm vs PowerInfer

A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.

anything-llmPowerInfer
TaglineStop renting your intelligence. Own it with AnythingLLM.High-speed Large Language Model Serving for Local Deployment
Stars63k9.6k
Forks6.9k585
Open issues328129
LanguageJavaScriptC++
LicenseMITMIT
Last pushedJul 7, 2026May 11, 2026
CategoriesAI Agents, Inference & Serving, Developer ToolsInference & Serving, LLM Frameworks

anything-llm

AnythingLLM is a JavaScript-based repository providing an all-in-one AI application for local-first agent experiences, including multimodal functionalities and self-hosted solutions.

JavaScript

PowerInfer

PowerInfer is a CPU/GPU LLM inference engine that utilizes activation locality to optimize performance on consumer-grade GPUs and CPUs.

C++