Home/AI Agents/aisix

aisix

api7/aisix

Open-source AI gateway for LLMs & AI agents

GitHub Website

GraphCanon updated today · GitHub synced today

64 stars9 forksLast push today Rust Apache-2.0

Decision brief

AISIX is a Rust-native AI gateway designed for routing and managing traffic to various AI providers

Good fit when

When you need an OpenAI-compatible API that can route requests to multiple LLM providers like OpenAI, Anthropic, Gemini, and Bedrock
When your application requires low per-request overhead due to its single static binary architecture built in Rust

Avoid when

If you require a fully managed service with minimal setup and configuration since AISIX requires self-hosting or connecting to AISIX Cloud for management features
For projects preferring dynamic languages over statically compiled binaries, given that AISIX is built in Rust and ships as one static binary

Pricing:: freemium - The open-source core (AISIX Gateway) can be used for free. For advanced features like team governance, budgets, and audit dashboard access, the AISIX Cloud is available on a managed SaaS model.
Requirements:: Requires etcd running to store configurations; Self-hosted setup requires Docker Compose for local testing with example configuration files

Observed Jul 15, 2026 · Source: enrich:decision_facts

aisix alternatives Trust report

Verify the decision

Adoption

Package downloads where a registry match exists. GitHub stars (64) are secondary evidence.

Docker Hub pulls (30d): 3,264·Docker Hub API·today

Maintenance and security

Full trust report

Maintenance: Very active (0d since push); As of today
Provenance: Not a fork · Organization account; As of today
Security (OSV): No lockfile; As of today

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

cargo add aisix

crates.io

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

ai-engineering-hub

Tutorials on LLMs, RAGs, and real-world AI agent applications

36k★

semantic-kernel

Integrate cutting-edge LLM technology quickly and easily into your apps

28k★

free-llm-api-resources

A list of free LLM inference resources accessible via API.

27k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

AISIX offers an OpenAI-compatible API built in Rust for routing and managing traffic to multiple AI providers like OpenAI, Anthropic, Gemini, Bedrock with features such as guardrails, caching, rate limits, and observability.

Capability facts

Deploy: Self-host
Source: dockerfile:Dockerfile · Jul 15, 2026
Docker: Dockerfile present
Source: dockerfile:Dockerfile · Jul 15, 2026
Languages: rust
Source: github.language · Jul 15, 2026

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

SSE transportSSE

Source: README excerpt (regex_v1, Jul 15, 2026)

govern, secure, and observe LLM traffic, with first-class SSE streaming and low gateway

Source link

README

AISIX AI Gateway

The open-source, Rust-native AI gateway for LLMs and AI agents

One OpenAI-compatible API in front of every model. Route, govern, secure, cache, and observe all your LLM and AI-agent traffic from a single control point — shipped as one static binary with low per-request overhead. Self-host for free, forever.

Built by the original creators of Apache APISIX.

Start free · Documentation · Quickstart · AISIX Cloud · Roadmap

AISIX AI Gateway is a Rust-native gateway that puts a single, OpenAI-compatible API in front of every LLM provider — OpenAI, Anthropic, Google Gemini, AWS Bedrock, Azure OpenAI, DeepSeek, and any OpenAI-compatible endpoint. It gives platform teams one place to route, govern, secure, and observe LLM traffic, with first-class SSE streaming and low gateway overhead.

It runs as a single static binary — low cold-start, lock-free config reads, dynamic configuration over etcd with no restarts. Run it self-hosted and free, or connect it to AISIX Cloud for a managed control plane with team governance, budgets, audit, and a dashboard.

AISIX AI Gateway (this repo) is the open-source core — the gateway/data plane. AISIX Cloud is the managed SaaS that adds the multi-tenant control plane on top. The proxy API is identical in both. New to AISIX Cloud? Start free →

⚡ Quickstart

AISIX is etcd-backed, so the fastest local run is Docker Compose (gateway + etcd). Grab the ready-to-run docker-compose.yml and example config.yaml from the self-hosted quickstart, then:

docker compose up          # proxy → :3000, admin API → :3001

Configure a model and an API key through the admin API on :3001 (quickstart), then call the gateway exactly like OpenAI:

curl http://localhost:3000/v1/chat/completions \
  -H "Authorization: Bearer $AISIX_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"my-model","messages":[{"role":"user","content":"hello"}]}'

✨ Why AISIX

One API, every model. Speak the OpenAI or Anthropic wire format in; the gateway translates to whichever provider each model points at. Point an OpenAI or Claude SDK at one base_url and switch models without changing code.
A real gateway, in Rust. Single static binary, low cold-start, lock-free config reads on the hot path, native streaming.
Open-source core, free forever. Apache-2.0, self-hostable end to end. Reach for AISIX Cloud only when you want the managed control plane.
Production controls built in. Routing & failover, rate limits, budgets, guardrails, caching, and observability ship in the box.

🧩 Features — available today

Covered by 90+ E2E tests.

OpenAI-compatible proxy (:3000) — chat/completions, responses, embeddings, rerank, images/generations, `audio/{speech,transcriptions,tr

For agents

This page has a .md twin and JSON over the API.

/tools/api7-aisix.md GET /api/graphcanon/tools/api7-aisix GET /api/graphcanon/graph?tool=api7-aisix