LocalAI
Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
GraphCanon updated 5d · GitHub synced 5d
Decision brief
LocalAI is an open-source AI engine that supports the deployment of various models including LLMs and applications related to vision and audio across multiple hardware types without needing a GPU.
Good fit when
- Use LocalAI when you need model flexibility, as it can run different types of models (LLMs, computer vision, speech & audio) on any type of hardware.
- Consider this tool for projects aiming for decentralized or distributed architectures given its support for technologies like libp2p.
Avoid when
- Avoid LocalAI if you need to leverage GPU-specific optimizations for performance acceleration as it promotes no-GPU usage, potentially sacrificing speed for accessibility.
- Do not use LocalAI where specific language runtime environments are required that do not align with Go (the language in which LocalAI is written).
- Pricing:
- freemium - As an open-source project under the MIT license, it is free to use and distribute.
Observed Jul 11, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (0d since push)
- As of 5d
- Provenance
- Not a fork · Personal account
- As of 5d
- Security (OSV)
- No MCP manifest
- As of 1mo
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
go get github.com/mudler/LocalAIHow it fits your stack(23)
Typed graph edges - alternatives, integrations, successors, and dependencies. Ranked by relationship type, not raw GitHub stars.
Alternative
Integrates
Related
Relationship graph
Optional deeper exploration of typed edges and category neighbours.
Similar tools
Same-category neighbours not already linked as typed edges.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
LocalAI is an open-source AI engine supporting various models including LLMs and applications related to vision, audio, and text generation for a wide range of hardware.
Capability facts
- Deploy
- Self-host
Source: dockerfile:Dockerfile · Aug 16, 2026
- Docker
- Dockerfile present
Source: dockerfile:Dockerfile · Aug 16, 2026
- Languages
- go
Source: github.language · Aug 16, 2026
Categories
Graph entities
Tags
README
Containers (Docker, podman, ...)
Already ran LocalAI before? Use
docker start -i local-aito restart an existing container.
CPU only:
docker run -ti --name local-ai -p 8080:8080 localai/localai:latest
NVIDIA GPU:
---
# From a standard OCI registry (e.g., Docker Hub)
local-ai run oci://localai/phi-2:latest
To work with a running LocalAI server from the terminal, start the built-in agent from another shell. It answers questions, reads your files and runs commands on your machine, asking you to approve anything that changes state. Inside a session, /models lists installed models and /model <name> switches between them. See the Terminal agent docs.
---
## License
LocalAI is a community-driven project created by [Ettore Di Giacinto](https://github.com/mudler/) and maintained by the [LocalAI team](#team).
MIT - Author Ettore Di Giacinto <mudler@localai.io>
For agents
This page has a .md twin and JSON over the API.