{"data":{"slug":"portkey-ai-gateway","name":"gateway","tagline":"A high-performance AI Gateway connecting to over 1,600 LLMs with guardrails.","github_url":"https://github.com/Portkey-AI/gateway","owner":"Portkey-AI","repo":"gateway","owner_avatar_url":"https://avatars.githubusercontent.com/u/131141116?v=4","primary_language":"TypeScript","stars":12668,"forks":1236,"topics":["ai-gateway","gateway","generative-ai","hacktoberfest","langchain","llm","llm-gateway","llmops","llms","mcp","mcp-client","mcp-gateway","mcp-servers","model-router","openai"],"archived":false,"github_pushed_at":"2026-05-25T13:54:51+00:00","maintenance_label":"Steady","stars_delta_30d":314,"url":"https://www.graphcanon.com/tools/portkey-ai-gateway","markdown_url":"https://www.graphcanon.com/tools/portkey-ai-gateway.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/portkey-ai-gateway","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=portkey-ai-gateway","description":"A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.","homepage_url":"https://portkey.ai/features/ai-gateway","license":"MIT","open_issues":242,"watchers":59,"ai_summary":"Portkey-AI/gateway is a platform that routes requests to multiple LLM providers while incorporating various guardrail mechanisms. It offers smart caching and usage analytics for cost management and efficient operations.","readme_excerpt":"# pip install -qU portkey-ai\n\nfrom portkey_ai import Portkey\n\n---\n\n### Cost Management\n- [**Smart caching**](https://portkey.wiki/gh-48): Cache responses from LLMs to reduce costs and improve latency. Supports simple and semantic* caching.\n- [**Usage analytics**](https://portkey.wiki/gh-49): Monitor and analyze your AI and LLM usage, including request volume, latency, costs and error rates.\n- [**Provider optimization***](https://portkey.wiki/gh-89): Automatically switch to the most cost-effective provider based on usage patterns and pricing models.\n\n---\n\n### Getting Started with the Community\nJoin our weekly AI Engineering Hours every Friday (8 AM PT) to:\n- Meet other contributors and community members\n- Learn advanced Gateway features and implementation patterns\n- Share your experiences and get help\n- Stay updated with the latest development priorities\n\n[Join the next session →](https://portkey.wiki/gh-101) | [Meeting notes](https://portkey.wiki/gh-102)\n\n<br>","github_created_at":"2023-08-23T11:52:47+00:00","created_at":"2026-07-07T17:41:41.667293+00:00","updated_at":"2026-08-07T18:01:45.880483+00:00","categories":[{"slug":"evaluation-observability","name":"Evaluation & Observability","url":"https://www.graphcanon.com/categories/evaluation-observability","markdown_url":"https://www.graphcanon.com/categories/evaluation-observability.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/evaluation-observability"},{"slug":"llm-frameworks","name":"LLM Frameworks","url":"https://www.graphcanon.com/categories/llm-frameworks","markdown_url":"https://www.graphcanon.com/categories/llm-frameworks.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/llm-frameworks"}],"tags":[{"slug":"ai-gateway","name":"ai-gateway"},{"slug":"gateway","name":"gateway"},{"slug":"generative-ai","name":"generative-ai"},{"slug":"langchain","name":"langchain"},{"slug":"llm","name":"llm"},{"slug":"llm-gateway","name":"llm-gateway"},{"slug":"llmops","name":"llmops"}],"trust":{"provenance":{"is_fork":false,"github_id":682080300,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-08-07T18:01:44.784Z","maintenance":{"label":"Steady","score":60,"methodology":"github_public_v1","releases_90d":0,"days_since_push":74,"last_release_at":"2026-01-12T08:46:07Z","stars_delta_30d":314,"open_issues_delta_30d":25},"security_summary":{"status":"no_manifest","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T10:39:51.225Z","medium_count":0,"scan_profile":"mcp_manifest","critical_count":0}},"capability_facts":{"mcp":{"source":"repo_scan","observed_at":"2026-08-07T18:01:45.255Z","server_manifest":false},"scan":{"source":"repo_scan","observed_at":"2026-08-07T18:01:45.255Z"},"deploy":{"source":"dockerfile:Dockerfile","self_host":true,"observed_at":"2026-08-07T18:01:45.255Z","managed_saas":false},"has_cli":{"value":true,"source":"package.json:bin|scripts","observed_at":"2026-08-07T18:01:45.255Z"},"languages":{"value":["typescript","javascript"],"source":"github.language+package.json","observed_at":"2026-08-07T18:01:45.255Z"},"has_docker":{"value":true,"source":"dockerfile:Dockerfile","observed_at":"2026-08-07T18:01:45.255Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-08-07T18:01:45.255Z"}},"decision_facts":{"hosting":null,"pricing":{"model":"unknown","summary":"The service is open source and MIT licensed; specific pricing for related services (if any) not detailed in repository."},"requirements":{"notes":["Developed using TypeScript; no Docker requirement specified for operation or development."],"min_ram_gb":null,"requires_docker":false},"constraints":{"min_ram_gb":null,"pricing_model":"unknown","requires_docker":false},"when_to_use":["Use gateway when you need a versatile platform capable of connecting to more than 1,600 LLM providers.","Utilize it if cost management is crucial as it provides smart caching and usage analytics tools.","Choose gateway for better data security and compliance due to the integration of over 50 AI guardrails."],"when_not_to_use":["Avoid using gateway if your application only requires connection to a limited number of LLM providers, as its extensive provider support might introduce unnecessary complexity.","If you don't require sophisticated cost management features such as smart caching or usage analytics provided by the tool, consider simpler alternatives."],"source":"enrich:decision_facts","observed_at":"2026-07-11T15:24:54.341Z"},"constraint_facets":{"min_ram_gb":null,"pricing_model":"unknown","requires_docker":false},"decision_summary":[{"label":"Pricing","value":"unknown - The service is open source and MIT licensed; specific pricing for related services (if any) not detailed in repository."},{"label":"Requirements","value":"Developed using TypeScript; no Docker requirement specified for operation or development."},{"label":"Adopt for","value":"A high-performance AI Gateway named 'gateway', supporting over 1,600 LLM connections and featuring various guardrail mechanisms for safer utilization."}]}}