SmarterRouter
Enrichment pendingSmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.
GraphCanon updated today · GitHub synced today
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Steady (66d since push)
- As of today
- Provenance
- Not a fork · Personal account
- As of today
- Security (OSV)
- 3 low (3 low)
- As of today
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
pip install SmarterRouterSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.
Capability facts
- Deploy
- Self-host
Source: dockerfile:Dockerfile · Jul 15, 2026
- Docker
- Dockerfile present
Source: dockerfile:Dockerfile · Jul 15, 2026
- CLI
- CLI entrypoint
Source: pyproject.toml:[project.scripts] · Jul 15, 2026
- Languages
- python
Source: github.language+pyproject.toml · Jul 15, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (regex_v1, Jul 15, 2026)
python -m smarterrouter generate-envSource link
Tags
README
Quick Start (5 minutes)
Get up and running with Docker in three commands:
---
# 2. Start with Docker Compose
docker-compose up -d
---
# Generate optimal .env file based on hardware detection
python -m smarterrouter generate-env
The setup wizard automatically:
- 🔍 Detects your Ollama installation (local, Docker, or remote)
- ⚙️ Identifies GPU hardware (NVIDIA, AMD, Intel, Apple Silicon)
- 📊 Analyzes available models and suggests optimal settings
- 📝 Generates a tailored
.envconfiguration file
One-Line Docker Deployment (New in v2.1.5)
For the simplest deployment experience, use the included script:
---
# Customize deployment
./docker-run.sh --port 11436 --data-dir ./smarterrouter-data --env-file .env
The script automatically:
- 🐳 Detects GPU vendor and configures appropriate Docker device mounts
- 📁 Creates persistent data directory
- 🔧 Generates optimal configuration for your hardware
- 🚀 Starts the container with proper restart policy
For production deployments, continue using docker-compose.yml with GPU-specific configurations.
License
MIT License - see LICENSE for details.
For agents
This page has a .md twin and JSON over the API.