GraphCanon updated 3w · GitHub synced 3w · 33 views this month
Decision brief
ODS is an AI platform for local deployment on PCs, enhancing them into capable servers with LLM inference, chat UI, voice integration, AI agents, workflows, RAG, and image generation.
Good fit when
- You prioritize owning your data over using cloud services
- Your project requires local deployment flexibility across PC platforms
Avoid when
- Cloud solutions are preferred for their scalability and resources
- You need specific AI capabilities not covered by ODS models
Observed Jul 17, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (0d since push)
- As of 3w
- Provenance
- Not a fork · Organization account
- As of 3w
- Security (OSV)
- No lockfile
- As of 1mo
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
pip install ODSSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
A multifunctional AI platform for local deployment on PCs, featuring LLM inference, chat UI, voice integration, and image generation capabilities.
Capability facts
- Languages
- python
Source: github.language · Jul 29, 2026
Categories
Tags
README
Hardware Auto-Detection
The installer detects your GPU and first assigns a deterministic hardware tier. Linux and macOS then run the versioned catalog selector (ods/scripts/select-model.py), while Windows uses the PowerShell catalog selector in ods/installers/windows/lib/tier-map.ps1; both read ods/config/model-library.json to choose the best installable GGUF for the detected memory envelope. The final choice is written to .env as LLM_MODEL, GGUF_FILE, MAX_CONTEXT, and MODEL_RECOMMENDATION_*.
MODEL_PROFILE=qwen is the default non-Gemma catalog profile, so the effective pick can be Qwen, Phi, or DeepSeek depending on what fits best. MODEL_PROFILE=gemma4 forces Gemma 4 where available, and MODEL_PROFILE=auto uses Gemma 4 on NVIDIA, Apple Silicon, and Intel Arc tiers. Override tier selection with ./install.sh --tier 3; override the model family with MODEL_PROFILE=gemma4 ./install.sh or MODEL_PROFILE=auto ./install.sh.
When Hermes is enabled, which is the default agent path, installers keep the first-run bootstrap model at a 64K context floor and promote the full local model context to 128K where the selected model supports it. That avoids Hermes's hard 64K minimum while preserving the under-2-minute first chat experience. The examples below are current catalog-selector outputs for common hardware envelopes; exact installs can differ with detected VRAM/RAM, host architecture, existing downloads, or explicit profile overrides. Throughput still needs a local benchmark after first launch.
License
Apache 2.0 — Use it, modify it, ship it. See LICENSE.
Built by Osmantic and the growing resistance that refuses to rent what should be owned.
For agents
This page has a .md twin and JSON over the API.