English | 中文 | 日本語

[!IMPORTANT] :rocket: Gateway 2.0 (Pre-Release) Portkey's core enterprise gateway is merging into open-source with our 2.0 release. You can try the pre-release branch here. Read more about what's next for Portkey in our Series A announcement.

The AI Gateway is designed for fast, reliable & secure routing to 1600+ language, vision, audio, and image models. It is a lightweight, open-source, and enterprise-ready solution that allows you to integrate with any language model in under 2 minutes.

• Blazing fast (<1ms latency) with a tiny footprint (122kb)
• Battle tested, with over 10B tokens processed everyday
• Enterprise-ready with enhanced security, scale, and custom deployments

What can you do with the AI Gateway?

• Integrate with any LLM in under 2 minutes - Quickstart
• Prevent downtimes through automatic retries and fallbacks
• Scale AI apps with load balancing and conditional routing
• Protect your AI deployments with guardrails
• Go beyond text with multi-modal capabilities
• Explore agentic workflow integrations
• Manage MCP servers with enterprise auth & observability using MCP Gateway

[!TIP] Starring this repo helps more developers discover the AI Gateway 🙏🏻

Quickstart (2 mins)

1. Setup your AI Gateway

# Run the gateway locally (needs Node.js and npm)
npx @portkey-ai/gateway

The Gateway is running on http://localhost:8787/v1

The Gateway Console is running on http://localhost:8787/public/

^{Deployment guides:   Portkey Cloud (Recommended)   Docker   Node.js   Cloudflare   Replit}