semantic-router
System level intelligent runtime for Mixture-of-Models across edge, data center and cloud
GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
42views this month
Decision brief
Semantic-Router is a Go-based intelligent runtime optimized for managing AI models across diverse deployment environments including edge devices, data centers, and cloud services.
Good fit when
- - Semantic-Router is ideal when you need an intelligent system to manage a mixture of AI models in different deployment contexts like edge, data center, or cloud.
- - Use it if your project involves fine-tuning models and deploying them efficiently using Kubernetes, leveraging its support for HuggingFace transformers and Candle libraries.
Avoid when
- - Avoid Semantic-Router if your organization strictly uses languages other than Go since the system is language-specific, which might complicate integration.
- - For projects that do not require cross-environment deployment capabilities (such as those exclusively running on cloud infrastructure), Semantic-Router may introduce unnecessary complexity.
- Pricing:
- freemium - Open-source under Apache-2.0 license, enabling free usage and modification with no cost for the core service.
- Requirements:
- Min 2 GB RAM; Requires Docker; Requires Go runtime and Docker setup, suitable environments include Kubernetes clusters.
Observed Jul 12, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (0d since push)
- As of Sep 19, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 19, 2026
- Security (OSV)
- No MCP manifest
- As of Jul 11, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Backing
Company context for vLLM. Display-only - separate from trust and ranking.
- Company
- vLLM·GitHub org profile·Jul 11, 2026
- Commercial model
- Pure OSS·GitHub org profile (public repos)·Jul 11, 2026
Install
go get github.com/vllm-project/semantic-routerSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Provides a smart runtime environment for managing mixed models of AI systems across different deployment environments like edge devices, data centers, and cloud services.
Capability facts
- Languages
- go
Source: github.language · Sep 19, 2026
Categories
Graph entities
Tags
README
Install For pip, uv, or agent driven installation, see the Installation Guide .
For agents
This page has a .md twin and JSON over the API.