{"data":{"slug":"mudler-localai","name":"LocalAI","tagline":"Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.","github_url":"https://github.com/mudler/LocalAI","owner":"mudler","repo":"LocalAI","owner_avatar_url":"https://avatars.githubusercontent.com/u/2420543?v=4","primary_language":"Go","stars":48500,"forks":4362,"topics":["agents","ai","api","audio-generation","decentralized","distributed","image-generation","libp2p","llama","llm","mamba","mcp","musicgen","object-detection","rerank","stable-diffusion","text-generation","tts"],"archived":false,"github_pushed_at":"2026-08-16T05:07:25+00:00","maintenance_label":"Very active","stars_delta_30d":924,"url":"https://www.graphcanon.com/tools/mudler-localai","markdown_url":"https://www.graphcanon.com/tools/mudler-localai.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/mudler-localai","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=mudler-localai","description":"LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.","homepage_url":"https://localai.io","license":"MIT","open_issues":156,"watchers":293,"ai_summary":"LocalAI is an open-source AI engine supporting various models including LLMs and applications related to vision, audio, and text generation for a wide range of hardware.","readme_excerpt":"### Containers (Docker, podman, ...)\n\n> Already ran LocalAI before? Use `docker start -i local-ai` to restart an existing container.\n\n#### CPU only:\n\n```bash\ndocker run -ti --name local-ai -p 8080:8080 localai/localai:latest\n```\n\n#### NVIDIA GPU:\n\n```bash\n\n---\n\n# From a standard OCI registry (e.g., Docker Hub)\nlocal-ai run oci://localai/phi-2:latest\n```\n\nTo work with a running LocalAI server from the terminal, start the built-in agent from another shell. It answers questions, reads your files and runs commands on your machine, asking you to approve anything that changes state. Inside a session, `/models` lists installed models and `/model <name>` switches between them. See the [Terminal agent](https://localai.io/docs/features/terminal-agent/) docs.\n\n```bash\n\n---\n\n## License\n\nLocalAI is a community-driven project created by [Ettore Di Giacinto](https://github.com/mudler/) and maintained by the [LocalAI team](#team).\n\nMIT - Author Ettore Di Giacinto <mudler@localai.io>","github_created_at":"2023-03-18T22:58:02+00:00","created_at":"2026-07-07T17:31:19.428222+00:00","updated_at":"2026-08-16T06:02:17.179685+00:00","categories":[{"slug":"computer-vision","name":"Computer Vision","url":"https://www.graphcanon.com/categories/computer-vision","markdown_url":"https://www.graphcanon.com/categories/computer-vision.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/computer-vision"},{"slug":"llm-frameworks","name":"LLM Frameworks","url":"https://www.graphcanon.com/categories/llm-frameworks","markdown_url":"https://www.graphcanon.com/categories/llm-frameworks.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/llm-frameworks"},{"slug":"speech-audio","name":"Speech & Audio","url":"https://www.graphcanon.com/categories/speech-audio","markdown_url":"https://www.graphcanon.com/categories/speech-audio.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/speech-audio"}],"tags":[{"slug":"agents","name":"agents"},{"slug":"ai","name":"ai"},{"slug":"api","name":"api"},{"slug":"audio-generation","name":"audio-generation"},{"slug":"decentralized","name":"decentralized"},{"slug":"distributed","name":"distributed"},{"slug":"image-generation","name":"image-generation"},{"slug":"libp2p","name":"libp2p"}],"trust":{"provenance":{"is_fork":false,"github_id":615869301,"owner_type":"User","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-08-16T06:02:16.416Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":26,"days_since_push":0,"last_release_at":"2026-08-07T15:53:43Z","stars_delta_30d":924,"open_issues_delta_30d":-53},"security_summary":{"status":"no_manifest","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T10:57:04.405Z","medium_count":0,"scan_profile":"mcp_manifest","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-08-16T06:02:16.836Z"},"deploy":{"source":"dockerfile:Dockerfile","self_host":true,"observed_at":"2026-08-16T06:02:16.836Z","managed_saas":false},"languages":{"value":["go"],"source":"github.language","observed_at":"2026-08-16T06:02:16.836Z"},"has_docker":{"value":true,"source":"dockerfile:Dockerfile","observed_at":"2026-08-16T06:02:16.836Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-08-16T06:02:16.836Z"}},"decision_facts":{"hosting":null,"pricing":{"model":"freemium","summary":"As an open-source project under the MIT license, it is free to use and distribute."},"requirements":{},"constraints":{"pricing_model":"freemium"},"when_to_use":["Use LocalAI when you need model flexibility, as it can run different types of models (LLMs, computer vision, speech & audio) on any type of hardware.","Consider this tool for projects aiming for decentralized or distributed architectures given its support for technologies like libp2p."],"when_not_to_use":["Avoid LocalAI if you need to leverage GPU-specific optimizations for performance acceleration as it promotes no-GPU usage, potentially sacrificing speed for accessibility.","Do not use LocalAI where specific language runtime environments are required that do not align with Go (the language in which LocalAI is written)."],"source":"enrich:decision_facts","observed_at":"2026-07-11T12:28:28.242Z"},"constraint_facets":{"pricing_model":"freemium"},"decision_summary":[{"label":"Pricing","value":"freemium - As an open-source project under the MIT license, it is free to use and distribute."},{"label":"Adopt for","value":"LocalAI is an open-source AI engine that supports the deployment of various models including LLMs and applications related to vision and audio across multiple hardware types without needing a GPU."}]}}