{"data":{"node":{"slug":"portkey-ai-gateway","name":"gateway","tagline":"A high-performance AI Gateway connecting to over 1,600 LLMs with guardrails.","github_url":"https://github.com/Portkey-AI/gateway","owner":"Portkey-AI","repo":"gateway","owner_avatar_url":"https://avatars.githubusercontent.com/u/131141116?v=4","primary_language":"TypeScript","stars":12668,"forks":1236,"topics":["ai-gateway","gateway","generative-ai","hacktoberfest","langchain","llm","llm-gateway","llmops","llms","mcp","mcp-client","mcp-gateway","mcp-servers","model-router","openai"],"archived":false,"github_pushed_at":"2026-05-25T13:54:51+00:00","maintenance_label":"Steady","stars_delta_30d":314,"url":"https://www.graphcanon.com/tools/portkey-ai-gateway","markdown_url":"https://www.graphcanon.com/tools/portkey-ai-gateway.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/portkey-ai-gateway","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=portkey-ai-gateway"},"categories":[{"slug":"evaluation-observability","name":"Evaluation & Observability","url":"https://www.graphcanon.com/categories/evaluation-observability","markdown_url":"https://www.graphcanon.com/categories/evaluation-observability.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/evaluation-observability"},{"slug":"llm-frameworks","name":"LLM Frameworks","url":"https://www.graphcanon.com/categories/llm-frameworks","markdown_url":"https://www.graphcanon.com/categories/llm-frameworks.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/llm-frameworks"}],"tags":[{"slug":"ai-gateway","name":"ai-gateway"},{"slug":"gateway","name":"gateway"},{"slug":"generative-ai","name":"generative-ai"},{"slug":"langchain","name":"langchain"},{"slug":"llm","name":"llm"},{"slug":"llm-gateway","name":"llm-gateway"},{"slug":"llmops","name":"llmops"}],"edges":[{"type":"alternative","direction":"out","explanation":"Both Portkey Gateway and GPTRouter provide similar functionality as gateways enabling interaction with multiple LLMs through a single API or interface.","successor_context":null,"tool":{"slug":"writesonic-gptrouter","name":"GPTRouter","tagline":"Manage multiple LLMs and image models for reliable and fast responses","github_url":"https://github.com/Writesonic/GPTRouter","owner":"Writesonic","repo":"GPTRouter","owner_avatar_url":"https://avatars.githubusercontent.com/u/83169781?v=4","primary_language":"TypeScript","stars":455,"forks":38,"topics":["anthropic","azure-openai","cohere","google-gemini","langchain","llama-index","llm","llmops","llms","mlops","openai","palm-api"],"archived":false,"github_pushed_at":"2024-04-10T11:14:59+00:00","maintenance_label":"Dormant","stars_delta_30d":0,"url":"https://www.graphcanon.com/tools/writesonic-gptrouter","markdown_url":"https://www.graphcanon.com/tools/writesonic-gptrouter.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/writesonic-gptrouter","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=writesonic-gptrouter"}},{"type":"alternative","direction":"out","explanation":"Both are gateways that provide access to multiple LLMs, acting as an interface for users to access different models via a single API or SDK.","successor_context":null,"tool":{"slug":"adaline-gateway","name":"gateway","tagline":"Unified SDK for calling over 200 LLMs","github_url":"https://github.com/adaline/gateway","owner":"adaline","repo":"gateway","owner_avatar_url":"https://avatars.githubusercontent.com/u/382430?v=4","primary_language":"TypeScript","stars":605,"forks":26,"topics":["ai","ai-agents","anthropic","language-model","llm","llmops","openai","prompt-engineering","togetherai","typescript"],"archived":false,"github_pushed_at":"2026-07-29T19:11:29+00:00","maintenance_label":"Active","stars_delta_30d":4,"url":"https://www.graphcanon.com/tools/adaline-gateway","markdown_url":"https://www.graphcanon.com/tools/adaline-gateway.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/adaline-gateway","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=adaline-gateway"}},{"type":"integrates_with","direction":"out","explanation":"Portkey-AI/gateway integrates with LangChain to provide a comprehensive solution for AI gateway and routing.","successor_context":null,"tool":{"slug":"langchain-ai-langchain","name":"langchain","tagline":"The agent engineering platform.","github_url":"https://github.com/langchain-ai/langchain","owner":"langchain-ai","repo":"langchain","owner_avatar_url":"https://avatars.githubusercontent.com/u/126733545?v=4","primary_language":"Python","stars":143615,"forks":23930,"topics":["agents","ai","ai-agents","anthropic","chatgpt","deepagents","enterprise","framework","gemini","generative-ai","langchain","langgraph","llm","multiagent","open-source","openai","pydantic","python","rag","typescript"],"archived":false,"github_pushed_at":"2026-08-07T08:27:07+00:00","maintenance_label":"Very active","stars_delta_30d":2337,"url":"https://www.graphcanon.com/tools/langchain-ai-langchain","markdown_url":"https://www.graphcanon.com/tools/langchain-ai-langchain.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/langchain-ai-langchain","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=langchain-ai-langchain"}},{"type":"alternative","direction":"out","explanation":"Both Portkey Gateway and LiteLLM serve as gateways that allow users to route their requests to multiple LLMs with a unified interface. They are alternatives in providing multi-LLM access.","successor_context":null,"tool":{"slug":"berriai-litellm","name":"litellm","tagline":"Python SDK and Proxy Server for calling multiple LLM APIs","github_url":"https://github.com/BerriAI/litellm","owner":"BerriAI","repo":"litellm","owner_avatar_url":"https://avatars.githubusercontent.com/u/121462774?v=4","primary_language":"Python","stars":55221,"forks":10231,"topics":["ai-gateway","anthropic","azure-openai","bedrock","gateway","langchain","litellm","llm","llm-gateway","llmops","mcp-gateway","openai","openai-proxy","rust","rust-ai","vertex-ai"],"archived":false,"github_pushed_at":"2026-08-01T05:53:28+00:00","maintenance_label":"Very active","url":"https://www.graphcanon.com/tools/berriai-litellm","markdown_url":"https://www.graphcanon.com/tools/berriai-litellm.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/berriai-litellm","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=berriai-litellm"}},{"type":"integrates_with","direction":"out","explanation":"Gateway integrates with litellm as both are AI gateway solutions that route requests to various language models, though gateway supports a larger number of models (over 1600) compared to litellm's over 100. The integration could enable extended model support and feature complementarity between the two tools.","successor_context":null,"tool":{"slug":"berriai-litellm","name":"litellm","tagline":"Python SDK and Proxy Server for calling multiple LLM APIs","github_url":"https://github.com/BerriAI/litellm","owner":"BerriAI","repo":"litellm","owner_avatar_url":"https://avatars.githubusercontent.com/u/121462774?v=4","primary_language":"Python","stars":55221,"forks":10231,"topics":["ai-gateway","anthropic","azure-openai","bedrock","gateway","langchain","litellm","llm","llm-gateway","llmops","mcp-gateway","openai","openai-proxy","rust","rust-ai","vertex-ai"],"archived":false,"github_pushed_at":"2026-08-01T05:53:28+00:00","maintenance_label":"Very active","url":"https://www.graphcanon.com/tools/berriai-litellm","markdown_url":"https://www.graphcanon.com/tools/berriai-litellm.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/berriai-litellm","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=berriai-litellm"}},{"type":"related","direction":"out","explanation":"AI Gateway can be considered a tool used within the AI Engineering Hub as it provides access to LLMs, but they aren't directly integrated or dependent on each other.","successor_context":null,"tool":{"slug":"patchy631-ai-engineering-hub","name":"ai-engineering-hub","tagline":"Tutorials on LLMs, RAGs, and real-world AI agent applications","github_url":"https://github.com/patchy631/ai-engineering-hub","owner":"patchy631","repo":"ai-engineering-hub","owner_avatar_url":"https://avatars.githubusercontent.com/u/38653995?v=4","primary_language":"Jupyter Notebook","stars":37020,"forks":6107,"topics":["agents","ai","llms","machine-learning","mcp","rag"],"archived":false,"github_pushed_at":"2026-07-27T18:43:06+00:00","maintenance_label":"Active","stars_delta_30d":463,"url":"https://www.graphcanon.com/tools/patchy631-ai-engineering-hub","markdown_url":"https://www.graphcanon.com/tools/patchy631-ai-engineering-hub.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/patchy631-ai-engineering-hub","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=patchy631-ai-engineering-hub"}},{"type":"related","direction":"out","explanation":"Quivr focuses on RAG integration in applications, which is adjacent to the goal of Portkey-AI/gateway to route various AI models and guardrails.","successor_context":null,"tool":{"slug":"quivrhq-quivr","name":"quivr","tagline":"Opiniated RAG for integrating GenAI in your apps 🧠","github_url":"https://github.com/QuivrHQ/quivr","owner":"QuivrHQ","repo":"quivr","owner_avatar_url":"https://avatars.githubusercontent.com/u/159330290?v=4","primary_language":"Python","stars":39401,"forks":3727,"topics":["ai","api","chatbot","chatgpt","database","docker","framework","frontend","groq","html","javascript","llm","openai","postgresql","privacy","rag","react","security","typescript","vector"],"archived":false,"github_pushed_at":"2025-07-09T12:55:23+00:00","maintenance_label":"Dormant","stars_delta_30d":188,"url":"https://www.graphcanon.com/tools/quivrhq-quivr","markdown_url":"https://www.graphcanon.com/tools/quivrhq-quivr.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/quivrhq-quivr","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=quivrhq-quivr"}},{"type":"integrates_with","direction":"out","explanation":"Gateway integrates with open-webui by providing secure and efficient routing services to the language models supported by open-webui, enabling seamless access and interaction with various LLM runners like Ollama and OpenAI-compatible APIs that are part of the open-webui platform.","successor_context":null,"tool":{"slug":"open-webui-open-webui","name":"open-webui","tagline":"User-friendly AI Interface (Supports Ollama, OpenAI API, ...)","github_url":"https://github.com/open-webui/open-webui","owner":"open-webui","repo":"open-webui","owner_avatar_url":"https://avatars.githubusercontent.com/u/158137808?v=4","primary_language":"Python","stars":148875,"forks":21676,"topics":["ai","llm","llm-ui","llm-webui","llms","mcp","ollama","ollama-webui","open-webui","openai","openapi","rag","self-hosted","ui","webui"],"archived":false,"github_pushed_at":"2026-08-15T07:10:16+00:00","maintenance_label":"Very active","stars_delta_30d":3224,"url":"https://www.graphcanon.com/tools/open-webui-open-webui","markdown_url":"https://www.graphcanon.com/tools/open-webui-open-webui.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/open-webui-open-webui","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=open-webui-open-webui"}},{"type":"integrates_with","direction":"out","explanation":"Daytona provides secure infrastructure for running AI-generated code which could integrate well with Portkey-AI/gateway’s routing capabilities.","successor_context":null,"tool":{"slug":"daytonaio-daytona","name":"daytona","tagline":"Secure and Elastic Infrastructure for Running AI-Generated Code","github_url":"https://github.com/daytonaio/daytona","owner":"daytonaio","repo":"daytona","owner_avatar_url":"https://avatars.githubusercontent.com/u/130513197?v=4","primary_language":null,"stars":71966,"forks":5653,"topics":["agentic-workflow","ai","ai-agents","ai-runtime","ai-sandboxes","code-execution","code-interpreter","developer-tools"],"archived":false,"github_pushed_at":"2026-07-24T07:12:07+00:00","maintenance_label":"Active","stars_delta_30d":-278,"url":"https://www.graphcanon.com/tools/daytonaio-daytona","markdown_url":"https://www.graphcanon.com/tools/daytonaio-daytona.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/daytonaio-daytona","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=daytonaio-daytona"}},{"type":"alternative","direction":"in","explanation":"free-llm-api-resources","successor_context":null,"tool":{"slug":"cheahjs-free-llm-api-resources","name":"free-llm-api-resources","tagline":"A list of free LLM inference resources accessible via API.","github_url":"https://github.com/cheahjs/free-llm-api-resources","owner":"cheahjs","repo":"free-llm-api-resources","owner_avatar_url":"https://avatars.githubusercontent.com/u/818368?v=4","primary_language":"Python","stars":27193,"forks":2830,"topics":["ai","claude","gemini","llama","llm","openai"],"archived":false,"github_pushed_at":"2026-07-14T03:24:15+00:00","maintenance_label":"Very active","url":"https://www.graphcanon.com/tools/cheahjs-free-llm-api-resources","markdown_url":"https://www.graphcanon.com/tools/cheahjs-free-llm-api-resources.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/cheahjs-free-llm-api-resources","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=cheahjs-free-llm-api-resources"}},{"type":"alternative","direction":"in","explanation":"Plano and Portkey both act as AI gateways with smart LLM routing, orchestration capabilities, and safety features. They serve similar needs for managing AI agents but may differ in specific features or performance.","successor_context":null,"tool":{"slug":"katanemo-plano","name":"plano","tagline":"An AI-native proxy and data plane for agentic apps","github_url":"https://github.com/katanemo/plano","owner":"katanemo","repo":"plano","owner_avatar_url":"https://avatars.githubusercontent.com/u/112724757?v=4","primary_language":"Rust","stars":7004,"forks":482,"topics":["ai-gateway","ai-gateway-support","envoy","envoyproxy","gateway","generative-ai","llm-gateway","llm-inference","llm-proxy","llm-routing","llmops","llms","openai","prompt","proxy","proxy-server","routing"],"archived":false,"github_pushed_at":"2026-08-19T19:29:08+00:00","maintenance_label":"Very active","stars_delta_30d":127,"url":"https://www.graphcanon.com/tools/katanemo-plano","markdown_url":"https://www.graphcanon.com/tools/katanemo-plano.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/katanemo-plano","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=katanemo-plano"}},{"type":"alternative","direction":"in","explanation":"Bifrost and portkey-ai-gateway both serve as high-performance AI gateways with integrated guardrails, making them direct alternatives in the market.","successor_context":null,"tool":{"slug":"maximhq-bifrost","name":"bifrost","tagline":"Fast Enterprise AI Gateway with Adaptive Load Balancer and Guardrails","github_url":"https://github.com/maximhq/bifrost","owner":"maximhq","repo":"bifrost","owner_avatar_url":"https://avatars.githubusercontent.com/u/139708451?v=4","primary_language":"Go","stars":7449,"forks":1073,"topics":["ai-gateway","gateway","gateway-services","generative-ai","guardrails","llm","llm-cost","llm-gateway","llm-observability","llmops","load-balancing","mcp-client","mcp-gateway","mcp-server","model-router","token-management"],"archived":false,"github_pushed_at":"2026-08-20T11:57:33+00:00","maintenance_label":"Very active","stars_delta_30d":812,"url":"https://www.graphcanon.com/tools/maximhq-bifrost","markdown_url":"https://www.graphcanon.com/tools/maximhq-bifrost.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/maximhq-bifrost","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=maximhq-bifrost"}}],"neighbours":[{"slug":"berriai-litellm","name":"litellm","tagline":"Python SDK and Proxy Server for calling multiple LLM APIs","github_url":"https://github.com/BerriAI/litellm","owner":"BerriAI","repo":"litellm","owner_avatar_url":"https://avatars.githubusercontent.com/u/121462774?v=4","primary_language":"Python","stars":55221,"forks":10231,"topics":["ai-gateway","anthropic","azure-openai","bedrock","gateway","langchain","litellm","llm","llm-gateway","llmops","mcp-gateway","openai","openai-proxy","rust","rust-ai","vertex-ai"],"archived":false,"github_pushed_at":"2026-08-01T05:53:28+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/berriai-litellm","markdown_url":"https://www.graphcanon.com/tools/berriai-litellm.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/berriai-litellm","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=berriai-litellm","shared_categories":["llm-frameworks"]},{"slug":"eugeneyan-open-llms","name":"open-llms","tagline":"A list of open LLMs available for commercial use.","github_url":"https://github.com/eugeneyan/open-llms","owner":"eugeneyan","repo":"open-llms","owner_avatar_url":"https://avatars.githubusercontent.com/u/6831355?v=4","primary_language":null,"stars":12849,"forks":985,"topics":["commercial","large-language-models","llm","llms"],"archived":false,"github_pushed_at":"2025-02-13T06:37:12+00:00","maintenance_label":"Dormant","url":"https://www.graphcanon.com/tools/eugeneyan-open-llms","markdown_url":"https://www.graphcanon.com/tools/eugeneyan-open-llms.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/eugeneyan-open-llms","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=eugeneyan-open-llms","shared_categories":["llm-frameworks"]},{"slug":"steven2358-awesome-generative-ai","name":"awesome-generative-ai","tagline":"A curated list of modern Generative Artificial Intelligence projects and services","github_url":"https://github.com/steven2358/awesome-generative-ai","owner":"steven2358","repo":"awesome-generative-ai","owner_avatar_url":"https://avatars.githubusercontent.com/u/164072?v=4","primary_language":null,"stars":12501,"forks":1990,"topics":["ai","artificial-intelligence","awesome","awesome-list","generative-ai","generative-art","large-language-models","llm"],"archived":false,"github_pushed_at":"2026-08-03T10:58:05+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/steven2358-awesome-generative-ai","markdown_url":"https://www.graphcanon.com/tools/steven2358-awesome-generative-ai.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/steven2358-awesome-generative-ai","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=steven2358-awesome-generative-ai","shared_categories":["llm-frameworks"]},{"slug":"theopenco-llmgateway","name":"llmgateway","tagline":"Route and manage LLM requests via unified API interface","github_url":"https://github.com/theopenco/llmgateway","owner":"theopenco","repo":"llmgateway","owner_avatar_url":"https://avatars.githubusercontent.com/u/211671860?v=4","primary_language":"TypeScript","stars":1518,"forks":170,"topics":["ai","ai-gateway","analytics","anthropic","api-key-management","claude","codex","enterprise","guardrails","inference","llm","llm-gateway","llm-proxy","llms","observability","openai","opencode","rate-limiting","typescript"],"archived":false,"github_pushed_at":"2026-08-09T00:38:36+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/theopenco-llmgateway","markdown_url":"https://www.graphcanon.com/tools/theopenco-llmgateway.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/theopenco-llmgateway","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=theopenco-llmgateway","shared_categories":[]},{"slug":"benman1-generative-ai-with-langchain","name":"generative_ai_with_langchain","tagline":"Build production-ready LLM applications and advanced agents using Python, LangChain, and LangGraph","github_url":"https://github.com/benman1/generative_ai_with_langchain","owner":"benman1","repo":"generative_ai_with_langchain","owner_avatar_url":"https://avatars.githubusercontent.com/u/10786684?v=4","primary_language":"Jupyter Notebook","stars":1400,"forks":582,"topics":["agent","chatgpt","claude","claude-3-5-sonnet","deepseek","deepseek-r1","gpt","gpt-4o","huggingface","langchain","langgraph","llamacpp","llms","ollama","openai"],"archived":false,"github_pushed_at":"2026-08-05T12:50:30+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/benman1-generative-ai-with-langchain","markdown_url":"https://www.graphcanon.com/tools/benman1-generative-ai-with-langchain.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/benman1-generative-ai-with-langchain","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=benman1-generative-ai-with-langchain","shared_categories":["llm-frameworks"]},{"slug":"adaline-gateway","name":"gateway","tagline":"Unified SDK for calling over 200 LLMs","github_url":"https://github.com/adaline/gateway","owner":"adaline","repo":"gateway","owner_avatar_url":"https://avatars.githubusercontent.com/u/382430?v=4","primary_language":"TypeScript","stars":605,"forks":26,"topics":["ai","ai-agents","anthropic","language-model","llm","llmops","openai","prompt-engineering","togetherai","typescript"],"archived":false,"github_pushed_at":"2026-07-29T19:11:29+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/adaline-gateway","markdown_url":"https://www.graphcanon.com/tools/adaline-gateway.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/adaline-gateway","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=adaline-gateway","shared_categories":["llm-frameworks"]},{"slug":"kaito-project-aikit","name":"aikit","tagline":"Fine-tune, build, and deploy open-source LLMs easily!","github_url":"https://github.com/kaito-project/aikit","owner":"kaito-project","repo":"aikit","owner_avatar_url":"https://avatars.githubusercontent.com/u/186863079?v=4","primary_language":"Go","stars":534,"forks":57,"topics":["ai","buildkit","chatgpt","docker","fine-tuning","finetuning","gemma","gpt","inference","kubernetes","large-language-models","llama","llm","localllama","mistral","mixtral","nvidia","open-llm","open-source-llm","openai"],"archived":false,"github_pushed_at":"2026-07-20T03:11:50+00:00","maintenance_label":"Steady","url":"https://www.graphcanon.com/tools/kaito-project-aikit","markdown_url":"https://www.graphcanon.com/tools/kaito-project-aikit.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/kaito-project-aikit","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=kaito-project-aikit","shared_categories":["llm-frameworks"]},{"slug":"writesonic-gptrouter","name":"GPTRouter","tagline":"Manage multiple LLMs and image models for reliable and fast responses","github_url":"https://github.com/Writesonic/GPTRouter","owner":"Writesonic","repo":"GPTRouter","owner_avatar_url":"https://avatars.githubusercontent.com/u/83169781?v=4","primary_language":"TypeScript","stars":455,"forks":38,"topics":["anthropic","azure-openai","cohere","google-gemini","langchain","llama-index","llm","llmops","llms","mlops","openai","palm-api"],"archived":false,"github_pushed_at":"2024-04-10T11:14:59+00:00","maintenance_label":"Dormant","url":"https://www.graphcanon.com/tools/writesonic-gptrouter","markdown_url":"https://www.graphcanon.com/tools/writesonic-gptrouter.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/writesonic-gptrouter","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=writesonic-gptrouter","shared_categories":["llm-frameworks"]},{"slug":"rogeriochaves-langstream","name":"langstream","tagline":"Build robust LLM applications with true composability","github_url":"https://github.com/rogeriochaves/langstream","owner":"rogeriochaves","repo":"langstream","owner_avatar_url":"https://avatars.githubusercontent.com/u/792201?v=4","primary_language":"Python","stars":417,"forks":28,"topics":[],"archived":false,"github_pushed_at":"2024-01-03T22:44:33+00:00","maintenance_label":"Dormant","url":"https://www.graphcanon.com/tools/rogeriochaves-langstream","markdown_url":"https://www.graphcanon.com/tools/rogeriochaves-langstream.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/rogeriochaves-langstream","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=rogeriochaves-langstream","shared_categories":["llm-frameworks"]},{"slug":"mohitsoni48-turbollm","name":"TurboLLM","tagline":"Run any local LLM engine auto-tuned to your GPU with polished web UI and OpenAI/Anthropic-compatible API","github_url":"https://github.com/mohitsoni48/TurboLLM","owner":"mohitsoni48","repo":"TurboLLM","owner_avatar_url":"https://avatars.githubusercontent.com/u/63787789?v=4","primary_language":"TypeScript","stars":225,"forks":36,"topics":["ai","anthropic-api","claude-code","gguf","gpu","inference","llama-cpp","llama-server","llm","local-llm","offline","openai-api","self-hosted"],"archived":false,"github_pushed_at":"2026-08-11T13:28:32+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/mohitsoni48-turbollm","markdown_url":"https://www.graphcanon.com/tools/mohitsoni48-turbollm.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/mohitsoni48-turbollm","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=mohitsoni48-turbollm","shared_categories":[]},{"slug":"ferro-labs-ai-gateway","name":"ai-gateway","tagline":"Unified AI Gateway for multiple LLMs with caching, guardrails, A/B testing, and cost controls","github_url":"https://github.com/ferro-labs/ai-gateway","owner":"ferro-labs","repo":"ai-gateway","owner_avatar_url":"https://avatars.githubusercontent.com/u/263849603?v=4","primary_language":"Go","stars":219,"forks":33,"topics":["ai-gateway","ai-infrastructure","guardrails","litellm","llm","llm-cost","llm-gateway","llm-proxy","llm-strategy","llmops","mcp","openai-compatible","pii-detection","prompt-management","semantic-cache","token-saver"],"archived":false,"github_pushed_at":"2026-08-07T05:08:04+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/ferro-labs-ai-gateway","markdown_url":"https://www.graphcanon.com/tools/ferro-labs-ai-gateway.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/ferro-labs-ai-gateway","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=ferro-labs-ai-gateway","shared_categories":[]},{"slug":"aipotheosis-labs-gate22","name":"gate22","tagline":"MCP gateway and control plane for agent governance","github_url":"https://github.com/aipotheosis-labs/gate22","owner":"aipotheosis-labs","repo":"gate22","owner_avatar_url":"https://avatars.githubusercontent.com/u/171570339?v=4","primary_language":"TypeScript","stars":175,"forks":23,"topics":["agents","ai","ai-agents","control-plane","gateway","guardrails","llm","mcp","mcp-tools","oauth2","open-source","permissions","policy-as-code","rbac"],"archived":false,"github_pushed_at":"2025-12-12T02:27:52+00:00","maintenance_label":"Slowing","url":"https://www.graphcanon.com/tools/aipotheosis-labs-gate22","markdown_url":"https://www.graphcanon.com/tools/aipotheosis-labs-gate22.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/aipotheosis-labs-gate22","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=aipotheosis-labs-gate22","shared_categories":["evaluation-observability"]}]}}