{"data":{"slug":"api7-aisix","name":"aisix","tagline":"Open-source AI gateway for LLMs & AI agents","github_url":"https://github.com/api7/aisix","owner":"api7","repo":"aisix","owner_avatar_url":"https://avatars.githubusercontent.com/u/61078451?v=4","primary_language":"Rust","stars":151,"forks":30,"topics":["ai-agents","ai-gateway","ai-gateway-rust","aisix","anthropic","bedrock","gateway","gemini","guardrails","inference-gateway","llm","llm-gateway","llm-proxy","llm-router","llmops","observability","openai","openai-compatible","rust","self-hosted"],"archived":false,"github_pushed_at":"2026-09-13T05:46:35+00:00","maintenance_label":"Very active","stars_delta_30d":59,"url":"https://www.graphcanon.com/tools/api7-aisix","markdown_url":"https://www.graphcanon.com/tools/api7-aisix.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/api7-aisix","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=api7-aisix","description":"Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.","homepage_url":"https://api7.ai/ai-gateway","license":"Apache-2.0","open_issues":106,"watchers":1,"ai_summary":"AISIX offers an OpenAI-compatible API built in Rust for routing and managing traffic to multiple AI providers like OpenAI, Anthropic, Gemini, Bedrock with features such as guardrails, caching, rate limits, and observability.","readme_excerpt":"<div align=\"center\">\n\n# AISIX AI Gateway\n\n### The open-source, Rust-native AI gateway for LLMs and AI agents\n\n**One OpenAI-compatible API in front of every model.** Route, govern, secure, cache, and\nobserve all your LLM and AI-agent traffic from a single control point — shipped as one\nstatic binary with low per-request overhead. Run it in your infrastructure for free,\nforever.\n\n*Built by the original creators of [Apache APISIX](https://apisix.apache.org/).*\n\n\n\n\n\n\n\n[**Start free**](https://api7.ai/ai-gateway?utm_source=github&utm_medium=readme&utm_campaign=ai-gateway) ·\n[**Documentation**](https://docs.api7.ai/ai-gateway/) ·\n[**Quickstart**](https://docs.api7.ai/ai-gateway/getting-started/gateway-quickstart) ·\n[**AISIX Cloud**](https://api7.ai/ai-gateway?utm_source=github&utm_medium=readme&utm_campaign=cloud) ·\n[**Roadmap**](ROADMAP.md)\n\n<br>\n\n<img src=\"assets/aisix-architecture.svg\" alt=\"AISIX AI Gateway architecture — one OpenAI- or Anthropic-compatible API in front of OpenAI, Anthropic, Gemini/Vertex, Bedrock, Azure OpenAI, and DeepSeek, with API key auth, rate and token limits, guardrails, caching, routing and failover, and observability in between\" width=\"100%\">\n\n</div>\n\n---\n\n**AISIX AI Gateway** is a Rust-native gateway that puts a single, OpenAI-compatible API in\nfront of every LLM provider — OpenAI, Anthropic, Google Gemini, AWS Bedrock, Azure OpenAI,\nDeepSeek, and any OpenAI-compatible endpoint. It gives platform teams one place to route,\ngovern, secure, and observe LLM traffic, with first-class SSE streaming and low gateway\noverhead.\n\nIt runs as a **single static binary** — low cold-start, lock-free config reads, and hot\nconfiguration reloads with no restarts: declare resources in one `resources.yaml` and\nreload on `SIGHUP`, or point the gateway at etcd for a multi-replica cluster. Run the\nopen-source gateway in your infrastructure, or connect it to\n**[AISIX Cloud](https://api7.ai/ai-gateway?utm_source=github&utm_medium=readme&utm_campaign=cloud)**\nfor centralized management with team governance, budgets, audit, and a dashboard.\n\n> **AISIX AI Gateway (this repo)** is the open-source product. It runs without a control\n> plane using declarative configuration or etcd. When connected to\n> **[AISIX Cloud](https://api7.ai/ai-gateway?utm_source=github&utm_medium=readme&utm_campaign=cloud)**,\n> the same gateway serves as the data plane. AISIX Cloud adds a commercial control plane,\n> either hosted by API7 (**Hybrid Cloud**) or hosted by you in your infrastructure\n> (**On-Premises**). In both options, the gateway runs in your environment and calls\n> providers directly; live AI traffic does not pass through the control plane or API7.\n> The proxy API is identical throughout.\n> **[Talk to us about AISIX Cloud →](https://api7.ai/contact?utm_source=github&utm_medium=readme&utm_campaign=cloud)**\n\n## ⚡ Quickstart\n\nOne container. No control plane, no database, no configuration store — the gateway reads\nevery dynamic resource from one declarative `resources.yaml`.\n\n```yaml\n# config.yaml\nresources_file: /etc/aisix/resources.yaml\nproxy:\n  addr: \"0.0.0.0:3000\"\nadmin:\n  enabled: false          # a declarative gateway needs no admin listener\nobservability:\n  metrics:\n    prometheus:\n      enabled: true\n      addr: \"0.0.0.0:9090\"\n```\n\n```yaml\n# resources.yaml\n_format_version: \"1\"\n\nprovider_keys:\n  - display_name: openai-main\n    provider: openai\n    api_key: ${OPENAI_API_KEY}        # interpolated from the environment\n\nmodels:\n  - display_name: my-model\n    provider: openai\n    model_name: gpt-4o-mini\n    provider_key: openai-main\n\napi_keys:\n  - display_name: local-dev\n    key_env: CALLER_API_KEY           # hashed at load; the plaintext is never stored\n    allowed_models: [\"my-model\"]\n```\n\n```bash\nexport OPENAI_API_KEY=\"YOUR_PROVIDER_KEY\"\nexport CALLER_API_KEY=\"YOUR_CALLER_KEY\"\n\ndocker run -d --name aisix \\\n  --platform linux/amd64 \\\n  -v \"$(pwd)/config.yaml:/etc/aisix/config.yaml:ro\" \\\n  -v \"$(pwd)/resources.yaml:/etc/aisix/resources.yaml:r","github_created_at":"2026-04-17T03:44:47+00:00","created_at":"2026-07-15T10:44:40.193782+00:00","updated_at":"2026-09-20T04:26:26.933406+00:00","categories":[{"slug":"ai-agents","name":"AI Agents","url":"https://www.graphcanon.com/categories/ai-agents","markdown_url":"https://www.graphcanon.com/categories/ai-agents.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/ai-agents"},{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"}],"tags":[{"slug":"ai-agents","name":"ai-agents"},{"slug":"llm-gateway","name":"llm-gateway"},{"slug":"observability","name":"observability"},{"slug":"openai-compatible","name":"openai-compatible"},{"slug":"self-hosted","name":"self-hosted"}],"trust":{"provenance":{"is_fork":false,"github_id":1213107705,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-09-13T06:00:36.045Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":20,"days_since_push":0,"last_release_at":"2026-09-08T14:19:19Z","stars_delta_30d":59,"open_issues_delta_30d":8},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-15T10:44:41.802Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-09-13T06:00:36.499Z"},"deploy":{"source":"dockerfile:Dockerfile","self_host":true,"observed_at":"2026-09-13T06:00:36.499Z","managed_saas":false},"languages":{"value":["rust"],"source":"github.language","observed_at":"2026-09-13T06:00:36.499Z"},"has_docker":{"value":true,"source":"dockerfile:Dockerfile","observed_at":"2026-09-13T06:00:36.499Z"},"license_spdx":{"value":"Apache-2.0","source":"github.license","observed_at":"2026-09-13T06:00:36.499Z"}},"decision_facts":{"hosting":null,"pricing":{"model":"freemium","summary":"The open-source core (AISIX Gateway) can be used for free. For advanced features like team governance, budgets, and audit dashboard access, the AISIX Cloud is available on a managed SaaS model."},"requirements":{"notes":["Requires etcd running to store configurations","Self-hosted setup requires Docker Compose for local testing with example configuration files"]},"constraints":{"pricing_model":"freemium"},"when_to_use":["When you need an OpenAI-compatible API that can route requests to multiple LLM providers like OpenAI, Anthropic, Gemini, and Bedrock","When your application requires low per-request overhead due to its single static binary architecture built in Rust"],"when_not_to_use":["If you require a fully managed service with minimal setup and configuration since AISIX requires self-hosting or connecting to AISIX Cloud for management features","For projects preferring dynamic languages over statically compiled binaries, given that AISIX is built in Rust and ships as one static binary"],"source":"enrich:decision_facts","observed_at":"2026-07-15T11:16:41.783Z"},"constraint_facets":{"pricing_model":"freemium"},"decision_summary":[{"label":"Pricing","value":"freemium - The open-source core (AISIX Gateway) can be used for free. For advanced features like team governance, budgets, and audit dashboard access, the AISIX Cloud is available on a managed SaaS model."},{"label":"Requirements","value":"Requires etcd running to store configurations; Self-hosted setup requires Docker Compose for local testing with example configuration files"},{"label":"Adopt for","value":"AISIX is a Rust-native AI gateway designed for routing and managing traffic to various AI providers"},{"label":"License detail","value":"AISIX is available under the Apache License, Version 2.0 which allows you to freely use, modify, and distribute it with proper attribution"}]}}