{"data":{"slug":"theopenco-llmgateway","name":"llmgateway","tagline":"Route and manage LLM requests via unified API interface","github_url":"https://github.com/theopenco/llmgateway","owner":"theopenco","repo":"llmgateway","owner_avatar_url":"https://avatars.githubusercontent.com/u/211671860?v=4","primary_language":"TypeScript","stars":1693,"forks":196,"topics":["ai","ai-gateway","analytics","anthropic","api-key-management","claude","codex","enterprise","guardrails","inference","llm","llm-gateway","llm-proxy","llms","observability","openai","opencode","rate-limiting","typescript"],"archived":false,"github_pushed_at":"2026-10-19T18:46:15+00:00","maintenance_label":"Very active","stars_delta_30d":69,"url":"https://www.graphcanon.com/tools/theopenco-llmgateway","markdown_url":"https://www.graphcanon.com/tools/theopenco-llmgateway.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/theopenco-llmgateway","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=theopenco-llmgateway","description":"Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.","homepage_url":"https://llmgateway.io","license":"Other","open_issues":78,"watchers":3,"ai_summary":"LLM Gateway offers an interface for routing, managing, and analyzing Large Language Model (LLM) requests from multiple providers with features like analytics, API key management, and rate limiting.","readme_excerpt":"## Getting Started\n\nYou can use LLM Gateway in two ways:\n\n- **Hosted Version**: For immediate use without setup, visit [llmgateway.io](https://llmgateway.io) to create an account and get an API key.\n- **Self-Hosted**: Deploy LLM Gateway on your own infrastructure for complete control over your data and configuration.\n\n---\n\n### Self-Hosted With Docker\n\nUse Docker-managed volumes for the unified image. Do not bind-mount a host directory directly to `/var/lib/postgresql/data`, because PostgreSQL initialization inside the container needs to set permissions on that directory and that can fail depending on the host filesystem and ownership.\n\n```bash\nexport LLM_GATEWAY_SECRET=\"$(openssl rand -base64 32 | tr -d '\\n')\"\nexport GATEWAY_API_KEY_HASH_SECRET=\"$(openssl rand -base64 32 | tr -d '\\n')\"\n./scripts/run-unified-container.sh\n```\n\nIf you prefer a one-off `docker run`, use named volumes instead of `~/some-host-dir`:\n\n```bash\ndocker volume create llmgateway_postgres\ndocker volume create llmgateway_redis\n\ndocker run -d \\\n  --name llmgateway \\\n  --restart unless-stopped \\\n  -p 3002:3002 \\\n  -p 3003:3003 \\\n  -p 3005:3005 \\\n  -p 3006:3006 \\\n  -p 3007:3007 \\\n  -p 4001:4001 \\\n  -p 4002:4002 \\\n  -v llmgateway_postgres:/var/lib/postgresql/data \\\n  -v llmgateway_redis:/var/lib/redis \\\n  -e AUTH_SECRET=\"$LLM_GATEWAY_SECRET\" \\\n  -e GATEWAY_API_KEY_HASH_SECRET=\"$GATEWAY_API_KEY_HASH_SECRET\" \\\n  ghcr.io/theopenco/llmgateway-unified:latest\n```\n\n---\n\n## License\n\nLLMGateway is available under a dual license:\n\n- **Open Source**: Core functionality is licensed under AGPLv3 - see the [LICENSE](LICENSE) file for details.\n- **Enterprise**: Commercial features in the `ee/` directory require an Enterprise license; multi-organization administration requires a white-label license. See [ee/LICENSE](ee/LICENSE) for details.","github_created_at":"2025-04-12T18:37:18+00:00","created_at":"2026-07-15T10:42:17.047695+00:00","updated_at":"2026-10-20T06:00:47.142771+00:00","categories":[{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"}],"tags":[{"slug":"ai-gateway","name":"ai-gateway"},{"slug":"api-key-management","name":"api-key-management"},{"slug":"observability","name":"observability"},{"slug":"rate-limiting","name":"rate-limiting"}],"trust":{"provenance":{"is_fork":false,"github_id":965250949,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-10-20T06:00:44.826Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":13,"days_since_push":0,"last_release_at":"2026-10-19T09:25:03Z","stars_delta_30d":69,"open_issues_delta_30d":1},"security_summary":{"last_scan_at":"2026-07-15T10:42:19.412835+00:00","scan_profile":"deps","status":"no_lockfile","critical_count":0,"high_count":0,"medium_count":0,"low_count":0,"scanner":"osv@v1","scan_id":"37a79f8a-b3c1-4edc-a916-feb4948d1c37","pending_review_count":0}},"capability_facts":{"mcp":{"method":"github-tree-and-contents@2","reason":"Inspection is incomplete; server presence is unknown.","source":"repo_scan","status":"unknown","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/tree/1a1791f264f911990dedd5727a92f3e04ee39743","observed_at":"2026-10-20T06:00:45.191Z","server_manifest":null},"scan":{"method":"github-tree-and-contents@2","source":"repo_scan","status":"partial","version":2,"coverage":{"scope":"bounded-repository-manifests","tree_complete":true,"selected_files":12,"candidate_files":25},"revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/tree/1a1791f264f911990dedd5727a92f3e04ee39743","observed_at":"2026-10-20T06:00:45.191Z","observations":[{"path":"@revision","bytes":4473,"status":"present","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/commit/1a1791f264f911990dedd5727a92f3e04ee39743","http_status":200,"observed_at":"2026-10-20T06:00:45.342Z"},{"path":"@tree","bytes":1732545,"status":"present","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/tree/1a1791f264f911990dedd5727a92f3e04ee39743","http_status":200,"observed_at":"2026-10-20T06:00:46.093Z"},{"path":"apps/airside/package.json","bytes":2365,"status":"present","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/blob/1a1791f264f911990dedd5727a92f3e04ee39743/apps/airside/package.json","http_status":200,"observed_at":"2026-10-20T06:00:46.226Z"},{"path":"apps/api/package.json","bytes":2375,"status":"present","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/blob/1a1791f264f911990dedd5727a92f3e04ee39743/apps/api/package.json","http_status":200,"observed_at":"2026-10-20T06:00:46.221Z"},{"path":"apps/code/package.json","bytes":2863,"status":"present","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/blob/1a1791f264f911990dedd5727a92f3e04ee39743/apps/code/package.json","http_status":200,"observed_at":"2026-10-20T06:00:46.228Z"},{"path":"apps/docs/package.json","bytes":2027,"status":"present","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/blob/1a1791f264f911990dedd5727a92f3e04ee39743/apps/docs/package.json","http_status":200,"observed_at":"2026-10-20T06:00:46.332Z"},{"path":"apps/gateway/package.json","bytes":1648,"status":"present","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/blob/1a1791f264f911990dedd5727a92f3e04ee39743/apps/gateway/package.json","http_status":200,"observed_at":"2026-10-20T06:00:46.346Z"},{"path":"apps/mobile/package.json","bytes":3784,"status":"present","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/blob/1a1791f264f911990dedd5727a92f3e04ee39743/apps/mobile/package.json","http_status":200,"observed_at":"2026-10-20T06:00:46.390Z"},{"path":"apps/playground/package.json","bytes":3912,"status":"present","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/blob/1a1791f264f911990dedd5727a92f3e04ee39743/apps/playground/package.json","http_status":200,"observed_at":"2026-10-20T06:00:46.367Z"},{"path":"apps/ui/package.json","bytes":3740,"status":"present","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/blob/1a1791f264f911990dedd5727a92f3e04ee39743/apps/ui/package.json","http_status":200,"observed_at":"2026-10-20T06:00:46.528Z"},{"path":"apps/worker/package.json","bytes":1051,"status":"present","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/blob/1a1791f264f911990dedd5727a92f3e04ee39743/apps/worker/package.json","http_status":200,"observed_at":"2026-10-20T06:00:46.497Z"},{"path":"Dockerfile","reason":"not-listed-in-complete-tree","status":"not-found","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/tree/1a1791f264f911990dedd5727a92f3e04ee39743","observed_at":"2026-10-20T06:00:46.104Z"},{"path":"ee/admin/package.json","bytes":2884,"status":"present","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/blob/1a1791f264f911990dedd5727a92f3e04ee39743/ee/admin/package.json","http_status":200,"observed_at":"2026-10-20T06:00:46.501Z"},{"path":"ee/audit/package.json","bytes":675,"status":"present","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/blob/1a1791f264f911990dedd5727a92f3e04ee39743/ee/audit/package.json","http_status":200,"observed_at":"2026-10-20T06:00:46.512Z"},{"path":"mcp.json","reason":"not-listed-in-complete-tree","status":"not-found","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/tree/1a1791f264f911990dedd5727a92f3e04ee39743","observed_at":"2026-10-20T06:00:46.104Z"},{"path":"package.json","bytes":6468,"status":"present","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/blob/1a1791f264f911990dedd5727a92f3e04ee39743/package.json","http_status":200,"observed_at":"2026-10-20T06:00:46.222Z"},{"path":"pyproject.toml","reason":"not-listed-in-complete-tree","status":"not-found","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/tree/1a1791f264f911990dedd5727a92f3e04ee39743","observed_at":"2026-10-20T06:00:46.104Z"},{"path":"server.json","reason":"not-listed-in-complete-tree","status":"not-found","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/tree/1a1791f264f911990dedd5727a92f3e04ee39743","observed_at":"2026-10-20T06:00:46.104Z"}]},"languages":{"value":["typescript","javascript"],"method":"github-tree-and-contents@2","source":"github.language+apps/api/package.json+package.json+apps/airside/package.json+apps/code/package.json+apps/docs/package.json+apps/gateway/package.json+apps/playground/package.json+apps/mobile/package.json+apps/worker/package.json+ee/admin/package.json+ee/audit/package.json+apps/ui/package.json","revision":"1a1791f264f911990dedd5727a92f3e04ee39743","source_url":"https://github.com/theopenco/llmgateway/tree/1a1791f264f911990dedd5727a92f3e04ee39743","observed_at":"2026-10-20T06:00:45.191Z"},"license_spdx":{"value":"Other","source":"github.license","observed_at":"2026-10-20T06:00:45.191Z"}},"decision_facts":{"hosting":{"model":"self_hosted","summary":"Available both as a hosted service at llmgateway.io and can be self-hosted using Docker for full control over configuration and data security."},"pricing":null,"requirements":{"notes":["Self-hosting must avoid direct binding of host directories to /var/lib/postgresql/data to prevent permission setting issues during PostgreSQL initialization."],"min_ram_gb":null,"requires_docker":true},"constraints":{"min_ram_gb":null,"hosting_model":"self_hosted","requires_docker":true},"when_to_use":["Your project requires interfacing with multiple LLM providers for diversified use cases.","You need complete control over your infrastructure through self-hosting options.","Enterprise-grade observability and API key management are necessary to meet security requirements."],"when_not_to_use":["The project only involves using a single LLM provider which does not necessitate the complexity of managing multiple gateways.","Development requirements do not include fine-grained rate limiting or detailed analytics that LLM Gateway provides.","Budget constraints and licensing considerations disallow the use of commercial features, given that core functionality is under AGPLv3."],"source":"enrich:decision_facts","observed_at":"2026-07-17T08:16:34.522Z"},"constraint_facets":{"min_ram_gb":null,"hosting_model":"self_hosted","requires_docker":true},"decision_summary":[{"label":"Hosting","value":"self hosted - Available both as a hosted service at llmgateway.io and can be self-hosted using Docker for full control over configuration and data security."},{"label":"Requirements","value":"Requires Docker; Self-hosting must avoid direct binding of host directories to /var/lib/postgresql/data to prevent permission setting issues during PostgreSQL initialization."},{"label":"Adopt for","value":"Unverified catalog guidance: LLM Gateway offers a unified API interface to route and manage Large Language Model requests from multiple providers with features such as analytics, API key management, and rate limiting."},{"label":"License detail","value":"Dual licensed: Open Source (Core - AGPLv3), Enterprise (Commercial Features - requires Enterprise license)"}]}}