{"data":{"slug":"osmantic-ods","name":"ODS","tagline":"Transform personal computers into AI servers.","github_url":"https://github.com/Osmantic/ODS","owner":"Osmantic","repo":"ODS","owner_avatar_url":"https://avatars.githubusercontent.com/u/262014141?v=4","primary_language":"Python","stars":6607,"forks":943,"topics":["ai-agents","amd","comfyui","docker","llama-cpp","llm","local-ai","n8n","nvidia","open-webui","rag","self-hosted","speech-to-text","strix-halo","text-to-speech","workflow-automation"],"archived":false,"github_pushed_at":"2026-09-20T07:02:35+00:00","maintenance_label":"Very active","stars_delta_30d":2808,"url":"https://www.graphcanon.com/tools/osmantic-ods","markdown_url":"https://www.graphcanon.com/tools/osmantic-ods.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/osmantic-ods","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=osmantic-ods","description":"Turn your PC, Mac, or Linux box into an AI server.  LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.","homepage_url":"https://discord.gg/qGVygYada3","license":"Apache-2.0","open_issues":3332,"watchers":40,"ai_summary":"A multifunctional AI platform for local deployment on PCs, featuring LLM inference, chat UI, voice integration, and image generation capabilities.","readme_excerpt":"## Hardware Auto-Detection\n\nThe installer detects your GPU and first assigns a deterministic hardware tier. Linux and macOS then run the versioned catalog selector (`ods/scripts/select-model.py`), while Windows uses the PowerShell catalog selector in `ods/installers/windows/lib/tier-map.ps1`; both read `ods/config/model-library.json` to choose the best installable GGUF for the detected memory envelope. The final choice is written to `.env` as `LLM_MODEL`, `GGUF_FILE`, `MAX_CONTEXT`, and `MODEL_RECOMMENDATION_*`.\n\n`MODEL_PROFILE=qwen` is the default non-Gemma catalog profile, so the effective pick can be Qwen, Phi, or DeepSeek depending on what fits best. `MODEL_PROFILE=gemma4` forces Gemma 4 where available, and `MODEL_PROFILE=auto` uses Gemma 4 on NVIDIA, Apple Silicon, and Intel Arc tiers. Override tier selection with `./install.sh --tier 3`; override the model family with `MODEL_PROFILE=gemma4 ./install.sh` or `MODEL_PROFILE=auto ./install.sh`.\n\nWhen Hermes is enabled, which is the default agent path, installers keep the first-run bootstrap model at a 64K context floor and promote the full local model context to 128K where the selected model supports it. That avoids Hermes's hard 64K minimum while preserving the under-2-minute first chat experience. The examples below are current catalog-selector outputs for common hardware envelopes; exact installs can differ with detected VRAM/RAM, host architecture, existing downloads, or explicit profile overrides. Throughput still needs a local benchmark after first launch.\n\n---\n\n## License\n\nApache 2.0 — Use it, modify it, ship it. See [LICENSE](LICENSE).\n\n---\n\n<div align=\"center\">\n\n*Built by [Osmantic](https://github.com/Osmantic) and the growing resistance that refuses to rent what should be owned.*\n\n</div>","github_created_at":"2026-02-09T13:14:58+00:00","created_at":"2026-07-11T12:08:12.763423+00:00","updated_at":"2026-09-20T07:07:55.814704+00:00","categories":[{"slug":"ai-agents","name":"AI Agents","url":"https://www.graphcanon.com/categories/ai-agents","markdown_url":"https://www.graphcanon.com/categories/ai-agents.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/ai-agents"},{"slug":"computer-vision","name":"Computer Vision","url":"https://www.graphcanon.com/categories/computer-vision","markdown_url":"https://www.graphcanon.com/categories/computer-vision.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/computer-vision"},{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"},{"slug":"speech-audio","name":"Speech & Audio","url":"https://www.graphcanon.com/categories/speech-audio","markdown_url":"https://www.graphcanon.com/categories/speech-audio.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/speech-audio"}],"tags":[{"slug":"ai-agents","name":"ai-agents"},{"slug":"amd","name":"amd"},{"slug":"docker","name":"docker"},{"slug":"llm","name":"llm"},{"slug":"local-ai","name":"local-ai"},{"slug":"n8n","name":"n8n"},{"slug":"nvidia","name":"nvidia"},{"slug":"open-webui","name":"open-webui"}],"trust":{"provenance":{"is_fork":false,"github_id":1153579168,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-09-20T07:07:53.461Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":1,"days_since_push":0,"last_release_at":"2026-07-28T14:37:53Z","stars_delta_30d":2808,"open_issues_delta_30d":3057},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T12:08:17.223Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-09-20T07:07:54.492Z"},"languages":{"value":["python"],"source":"github.language","observed_at":"2026-09-20T07:07:54.492Z"},"license_spdx":{"value":"Apache-2.0","source":"github.license","observed_at":"2026-09-20T07:07:54.492Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":null,"constraints":null,"when_to_use":["You prioritize owning your data over using cloud services","Your project requires local deployment flexibility across PC platforms","Hardware auto-detection is critical for efficient resource allocation"],"when_not_to_use":["Cloud solutions are preferred for their scalability and resources","You need specific AI capabilities not covered by ODS models","Exact control over hardware tier selection is less important to your workflow"],"source":"enrich:decision_facts","observed_at":"2026-07-17T01:17:48.982Z"},"constraint_facets":null,"decision_summary":[{"label":"Adopt for","value":"ODS is an AI platform for local deployment on PCs, enhancing them into capable servers with LLM inference, chat UI, voice integration, AI agents, workflows, RAG, and image generation."}]}}