bifrost

maximhq/bifrost

Fastest enterprise AI gateway with adaptive load balancer, cluster mode, guardrails, and support for over 1000 models.

6.3k
Stars
857
Forks
565
Open issues
25
Watchers
Go Apache-2.0Last pushed Jul 7, 2026

Overview

Bifrost is a high-performance AI gateway that offers fast access to multiple providers through a single OpenAI-compatible API. It provides features such as automatic failover, load balancing, and enterprise-grade security.

Categories

Tags

Similar tools

Install

go get github.com/maximhq/bifrost

README

Bifrost AI Gateway

Run In Postman

The fastest way to build AI applications that never go down

Bifrost is a high-performance AI gateway that unifies access to 23+ providers (OpenAI, Anthropic, AWS Bedrock, Google Vertex, and more) through a single OpenAI-compatible API. Deploy in seconds with zero configuration and get automatic failover, load balancing, semantic caching, and enterprise-grade features.

Quick Start

Go from zero to production-ready AI gateway in under a minute.

Step 1: Start Bifrost Gateway

# Install and run locally
npx -y @maximhq/bifrost

# Or use Docker
docker run -p 8080:8080 maximhq/bifrost

Step 2: Configure via Web UI

# Open the built-in web interface
open http://localhost:8080

Step 3: Make your first API call

curl -X POST http://localhost:8080/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "openai/gpt-4o-mini",
    "messages": [{"role": "user", "content": "Hello, Bifrost!"}]
  }'

That's it! Your AI gateway is running with a web interface for visual configuration, real-time monitoring, and analytics.

Complete Setup Guides:


Enterprise Deployments

Bifrost supports enterprise-grade, private deployments for teams running production AI systems at scale. In addition to private networking, custom security controls, and governance, enterprise deployments unlock advanced capabilities including adaptive load balancing, clustering, guardrails, MCP gateway and and other features designed for enterprise-grade scale and reliability.


Key Features

Core Infrastructure

  • Unified Interface - Single OpenAI-compatible API for all providers
  • Multi-Provider Support - OpenAI, Anthropic, AWS Bedrock, Google Vertex, Azure, Cerebras, Cohere, Mistral, Ollama, Groq, and more
  • Automatic Fallbacks - Seamless failover between providers and models with zero downtime
  • Load Balancing - Intelligent request distribution across multiple API keys and providers

Advanced Features