{"data":{"slug":"mudler-localai","name":"LocalAI","tagline":"Open-source AI engine for running various models on any hardware","github_url":"https://github.com/mudler/LocalAI","owner":"mudler","repo":"LocalAI","owner_avatar_url":"https://avatars.githubusercontent.com/u/2420543?v=4","primary_language":"Go","stars":49150,"forks":4457,"topics":["agents","ai","api","audio-generation","decentralized","distributed","image-generation","libp2p","llama","llm","mamba","mcp","musicgen","object-detection","rerank","stable-diffusion","text-generation","tts"],"archived":false,"github_pushed_at":"2026-09-18T08:36:38+00:00","maintenance_label":"Very active","stars_delta_30d":650,"url":"https://www.graphcanon.com/tools/mudler-localai","markdown_url":"https://www.graphcanon.com/tools/mudler-localai.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/mudler-localai","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=mudler-localai","description":"LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.","homepage_url":"https://localai.io","license":"MIT","open_issues":178,"watchers":300,"ai_summary":"LocalAI is an open-source AI engine that supports running a variety of models including LLMs, vision, voice, image, and video models on any hardware without requiring a GPU.","readme_excerpt":"### Containers (Docker, podman, ...)\n\n> Already ran LocalAI before? Use `docker start -i local-ai` to restart an existing container.\n\n#### CPU only:\n\n```bash\ndocker run -ti --name local-ai -p 8080:8080 localai/localai:latest\n```\n\n#### NVIDIA GPU:\n\n```bash\n\n---\n\n# From a standard OCI registry (e.g., Docker Hub)\nlocal-ai run oci://localai/phi-2:latest\n```\n\nTo work with a running LocalAI server from the terminal, start the built-in agent from another shell. It answers questions, reads your files and runs commands on your machine, asking you to approve anything that changes state. Inside a session, `/models` lists installed models and `/model <name>` switches between them. See the [Terminal agent](https://localai.io/docs/features/terminal-agent/) docs.\n\n```bash\n\n---\n\n## License\n\nLocalAI is a community-driven project created by [Ettore Di Giacinto](https://github.com/mudler/) and maintained by the [LocalAI team](#team).\n\nMIT - Author Ettore Di Giacinto <mudler@localai.io>","github_created_at":"2023-03-18T22:58:02+00:00","created_at":"2026-07-07T17:31:19.428222+00:00","updated_at":"2026-09-20T04:32:19.857731+00:00","categories":[{"slug":"ai-agents","name":"AI Agents","url":"https://www.graphcanon.com/categories/ai-agents","markdown_url":"https://www.graphcanon.com/categories/ai-agents.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/ai-agents"},{"slug":"computer-vision","name":"Computer Vision","url":"https://www.graphcanon.com/categories/computer-vision","markdown_url":"https://www.graphcanon.com/categories/computer-vision.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/computer-vision"},{"slug":"data-retrieval","name":"Data & Retrieval","url":"https://www.graphcanon.com/categories/data-retrieval","markdown_url":"https://www.graphcanon.com/categories/data-retrieval.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/data-retrieval"},{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"},{"slug":"llm-frameworks","name":"LLM Frameworks","url":"https://www.graphcanon.com/categories/llm-frameworks","markdown_url":"https://www.graphcanon.com/categories/llm-frameworks.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/llm-frameworks"},{"slug":"model-training","name":"Model Training","url":"https://www.graphcanon.com/categories/model-training","markdown_url":"https://www.graphcanon.com/categories/model-training.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/model-training"},{"slug":"speech-audio","name":"Speech & Audio","url":"https://www.graphcanon.com/categories/speech-audio","markdown_url":"https://www.graphcanon.com/categories/speech-audio.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/speech-audio"}],"tags":[{"slug":"agents","name":"agents"},{"slug":"ai","name":"ai"},{"slug":"api","name":"api"},{"slug":"audio-generation","name":"audio-generation"},{"slug":"decentralized","name":"decentralized"},{"slug":"distributed","name":"distributed"},{"slug":"image-generation","name":"image-generation"},{"slug":"libp2p","name":"libp2p"}],"trust":{"provenance":{"is_fork":false,"github_id":615869301,"owner_type":"User","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-09-18T08:38:40.966Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":16,"days_since_push":0,"last_release_at":"2026-09-17T19:46:38Z","stars_delta_30d":650,"open_issues_delta_30d":22},"security_summary":{"status":"findings","scanner":"osv@v1","low_count":15,"high_count":0,"last_scan_at":"2026-09-18T08:38:42.614Z","medium_count":0,"scan_profile":"deps","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-09-18T08:38:39.796Z"},"deploy":{"source":"dockerfile:Dockerfile","self_host":true,"observed_at":"2026-09-18T08:38:39.796Z","managed_saas":false},"languages":{"value":["go"],"source":"github.language","observed_at":"2026-09-18T08:38:39.796Z"},"has_docker":{"value":true,"source":"dockerfile:Dockerfile","observed_at":"2026-09-18T08:38:39.796Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-09-18T08:38:39.796Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":null,"constraints":null,"when_to_use":["When you need to run AI models on hardware that lacks a GPU, as LocalAI supports CPU-only operations.","If you are working with a diverse set of models including LLMs, vision, voice, image, and video models, and require a single engine to handle all.","For projects that benefit from decentralized and distributed computing, as LocalAI supports technologies like libp2p."],"when_not_to_use":["If your project specifically requires GPU acceleration for performance reasons, as LocalAI can run on CPU-only setups but may not offer the same speed as GPU-accelerated alternatives.","When you need a tool that is tightly integrated with specific cloud services or proprietary hardware, as LocalAI is designed for flexibility across different hardware types.","If your project demands a proprietary solution with commercial support, as LocalAI is an open-source project with community-driven support."],"source":"enrich:decision_facts","observed_at":"2026-09-18T11:26:22.800Z"},"constraint_facets":null,"decision_summary":[{"label":"Adopt for","value":"LocalAI is an open-source AI engine that supports running a variety of models including LLMs, vision, voice, image, and video models on any hardware without requiring a GPU."}]}}