semantic-router
System level intelligent runtime for Mixture-of-Models across edge, data center and cloud
GraphCanon updated 2d · GitHub synced 2d · 28 views this month
Decision brief
Semantic-Router is a Go-based intelligent runtime optimized for managing AI models across diverse deployment environments including edge devices, data centers, and cloud services.
Good fit when
- - Semantic-Router is ideal when you need an intelligent system to manage a mixture of AI models in different deployment contexts like edge, data center, or cloud.
- - Use it if your project involves fine-tuning models and deploying them efficiently using Kubernetes, leveraging its support for HuggingFace transformers and Candle libraries.
Avoid when
- - Avoid Semantic-Router if your organization strictly uses languages other than Go since the system is language-specific, which might complicate integration.
- - For projects that do not require cross-environment deployment capabilities (such as those exclusively running on cloud infrastructure), Semantic-Router may introduce unnecessary complexity.
- Pricing:
- freemium - Open-source under Apache-2.0 license, enabling free usage and modification with no cost for the core service.
- Requirements:
- Min 2 GB RAM; Requires Docker; Requires Go runtime and Docker setup, suitable environments include Kubernetes clusters.
Observed Jul 12, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (0d since push)
- As of 2d
- Provenance
- Not a fork · Organization account
- As of 2d
- Security (OSV)
- No MCP manifest
- As of 1mo
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Backing
Company context for vLLM. Display-only - separate from trust and ranking.
- Company
- vLLM·GitHub org profile·1mo
- Commercial model
- Pure OSS·GitHub org profile (public repos)·1mo
Install
go get github.com/vllm-project/semantic-routerSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Provides a smart runtime environment for managing mixed models of AI systems across different deployment environments like edge devices, data centers, and cloud services.
Capability facts
- Languages
- go
Source: github.language · Aug 23, 2026
Categories
Graph entities
Tags
README
Install
curl -fsSL https://vllm-sr.ai/install.sh | bash
For platform notes, detailed setup options, and troubleshooting, see the Installation Guide.
Online playground credentials
- Username:
love@vllm-sr.ai - Password:
vllm-sr
For agents
This page has a .md twin and JSON over the API.