{"data":{"slug":"api7-aisix","name":"aisix","tagline":"Open-source AI gateway for LLMs & AI agents","github_url":"https://github.com/api7/aisix","owner":"api7","repo":"aisix","owner_avatar_url":"https://avatars.githubusercontent.com/u/61078451?v=4","primary_language":"Rust","stars":64,"forks":9,"topics":["ai-agents","ai-gateway","ai-gateway-rust","aisix","anthropic","bedrock","gateway","gemini","guardrails","inference-gateway","llm","llm-gateway","llm-proxy","llm-router","llmops","observability","openai","openai-compatible","rust","self-hosted"],"archived":false,"github_pushed_at":"2026-07-15T08:45:29+00:00","maintenance_label":"Very active","url":"https://www.graphcanon.com/tools/api7-aisix","markdown_url":"https://www.graphcanon.com/tools/api7-aisix.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/api7-aisix","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=api7-aisix","description":"Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.","homepage_url":"https://api7.ai/ai-gateway","license":"Apache-2.0","open_issues":77,"watchers":1,"ai_summary":"AISIX offers an OpenAI-compatible API built in Rust for routing and managing traffic to multiple AI providers like OpenAI, Anthropic, Gemini, Bedrock with features such as guardrails, caching, rate limits, and observability.","readme_excerpt":"<div align=\"center\">\n\n# AISIX AI Gateway\n\n### The open-source, Rust-native AI gateway for LLMs and AI agents\n\n**One OpenAI-compatible API in front of every model.** Route, govern, secure, cache, and\nobserve all your LLM and AI-agent traffic from a single control point — shipped as one\nstatic binary with low per-request overhead. Self-host for free, forever.\n\n*Built by the original creators of [Apache APISIX](https://apisix.apache.org/).*\n\n\n\n\n\n\n\n[**Start free**](https://api7.ai/ai-gateway?utm_source=github&utm_medium=readme&utm_campaign=ai-gateway) ·\n[**Documentation**](https://docs.api7.ai/ai-gateway/) ·\n[**Quickstart**](https://docs.api7.ai/ai-gateway/getting-started/self-hosted-quickstart) ·\n[**AISIX Cloud**](https://api7.ai/ai-gateway?utm_source=github&utm_medium=readme&utm_campaign=cloud) ·\n[**Roadmap**](ROADMAP.md)\n\n<br>\n\n<img src=\"assets/aisix-architecture.svg\" alt=\"AISIX AI Gateway architecture — one OpenAI- or Anthropic-compatible API in front of OpenAI, Anthropic, Gemini/Vertex, Bedrock, Azure OpenAI, and DeepSeek, with API key auth, rate limits and budgets, guardrails, caching, routing and failover, and observability in between\" width=\"100%\">\n\n</div>\n\n---\n\n**AISIX AI Gateway** is a Rust-native gateway that puts a single, OpenAI-compatible API in\nfront of every LLM provider — OpenAI, Anthropic, Google Gemini, AWS Bedrock, Azure OpenAI,\nDeepSeek, and any OpenAI-compatible endpoint. It gives platform teams one place to route,\ngovern, secure, and observe LLM traffic, with first-class SSE streaming and low gateway\noverhead.\n\nIt runs as a **single static binary** — low cold-start, lock-free config reads, dynamic\nconfiguration over etcd with no restarts. Run it **self-hosted and free**, or connect it to\n**[AISIX Cloud](https://api7.ai/ai-gateway?utm_source=github&utm_medium=readme&utm_campaign=cloud)**\nfor a managed control plane with team governance, budgets, audit, and a dashboard.\n\n> **AISIX AI Gateway (this repo)** is the open-source core — the gateway/data plane.\n> **[AISIX Cloud](https://api7.ai/ai-gateway?utm_source=github&utm_medium=readme&utm_campaign=cloud)**\n> is the managed SaaS that adds the multi-tenant control plane on top. The proxy API is\n> identical in both. **New to AISIX Cloud? [Start free →](https://api7.ai/ai-gateway?utm_source=github&utm_medium=readme&utm_campaign=cloud)**\n\n## ⚡ Quickstart\n\nAISIX is etcd-backed, so the fastest local run is Docker Compose (gateway + etcd). Grab the\nready-to-run `docker-compose.yml` and example `config.yaml` from the\n[self-hosted quickstart](https://docs.api7.ai/ai-gateway/getting-started/self-hosted-quickstart), then:\n\n```bash\ndocker compose up          # proxy → :3000, admin API → :3001\n```\n\nConfigure a model and an API key through the admin API on `:3001`\n([quickstart](https://docs.api7.ai/ai-gateway/getting-started/self-hosted-quickstart)),\nthen call the gateway exactly like OpenAI:\n\n```bash\ncurl http://localhost:3000/v1/chat/completions \\\n  -H \"Authorization: Bearer $AISIX_API_KEY\" \\\n  -H \"Content-Type: application/json\" \\\n  -d '{\"model\":\"my-model\",\"messages\":[{\"role\":\"user\",\"content\":\"hello\"}]}'\n```\n\n## ✨ Why AISIX\n\n- **One API, every model.** Speak the OpenAI *or* Anthropic wire format in; the gateway\n  translates to whichever provider each model points at. Point an OpenAI or Claude SDK at\n  one `base_url` and switch models without changing code.\n- **A real gateway, in Rust.** Single static binary, low cold-start, lock-free config reads\n  on the hot path, native streaming.\n- **Open-source core, free forever.** Apache-2.0, self-hostable end to end. Reach for\n  AISIX Cloud only when you want the managed control plane.\n- **Production controls built in.** Routing & failover, rate limits, budgets, guardrails,\n  caching, and observability ship in the box.\n\n## 🧩 Features — available today\n\nCovered by 90+ E2E tests.\n\n- **OpenAI-compatible proxy** (`:3000`) — `chat/completions`, `responses`, `embeddings`,\n  `rerank`, `images/generations`, `audio/{speech,transcriptions,tr","github_created_at":"2026-04-17T03:44:47+00:00","created_at":"2026-07-15T10:44:40.193782+00:00","updated_at":"2026-07-15T11:16:41.946808+00:00","categories":[{"slug":"ai-agents","name":"AI Agents","url":"https://www.graphcanon.com/categories/ai-agents","markdown_url":"https://www.graphcanon.com/categories/ai-agents.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/ai-agents"},{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"}],"tags":[{"slug":"ai-agents","name":"ai-agents"},{"slug":"llm-gateway","name":"llm-gateway"},{"slug":"observability","name":"observability"},{"slug":"openai-compatible","name":"openai-compatible"},{"slug":"self-hosted","name":"self-hosted"}],"trust":{"provenance":{"is_fork":false,"github_id":1213107705,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-07-15T10:44:41.319Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":4,"days_since_push":0,"last_release_at":"2026-07-09T03:49:24Z"},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-15T10:44:41.802Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-07-15T11:15:59.868Z"},"deploy":{"source":"dockerfile:Dockerfile","self_host":true,"observed_at":"2026-07-15T11:15:59.868Z","managed_saas":false},"languages":{"value":["rust"],"source":"github.language","observed_at":"2026-07-15T11:15:59.868Z"},"has_docker":{"value":true,"source":"dockerfile:Dockerfile","observed_at":"2026-07-15T11:15:59.868Z"},"license_spdx":{"value":"Apache-2.0","source":"github.license","observed_at":"2026-07-15T11:15:59.868Z"}},"decision_facts":{"hosting":null,"pricing":{"model":"freemium","summary":"The open-source core (AISIX Gateway) can be used for free. For advanced features like team governance, budgets, and audit dashboard access, the AISIX Cloud is available on a managed SaaS model."},"requirements":{"notes":["Requires etcd running to store configurations","Self-hosted setup requires Docker Compose for local testing with example configuration files"]},"constraints":{"pricing_model":"freemium"},"when_to_use":["When you need an OpenAI-compatible API that can route requests to multiple LLM providers like OpenAI, Anthropic, Gemini, and Bedrock","When your application requires low per-request overhead due to its single static binary architecture built in Rust"],"when_not_to_use":["If you require a fully managed service with minimal setup and configuration since AISIX requires self-hosting or connecting to AISIX Cloud for management features","For projects preferring dynamic languages over statically compiled binaries, given that AISIX is built in Rust and ships as one static binary"],"source":"enrich:decision_facts","observed_at":"2026-07-15T11:16:41.783Z"},"constraint_facets":{"pricing_model":"freemium"},"decision_summary":[{"label":"Pricing","value":"freemium - The open-source core (AISIX Gateway) can be used for free. For advanced features like team governance, budgets, and audit dashboard access, the AISIX Cloud is available on a managed SaaS model."},{"label":"Requirements","value":"Requires etcd running to store configurations; Self-hosted setup requires Docker Compose for local testing with example configuration files"},{"label":"Adopt for","value":"AISIX is a Rust-native AI gateway designed for routing and managing traffic to various AI providers"},{"label":"License detail","value":"AISIX is available under the Apache License, Version 2.0 which allows you to freely use, modify, and distribute it with proper attribution"}]}}