ai-gateway logo

ai-gateway

ferro-labs/ai-gateway

Unified AI Gateway for multiple LLMs with caching, guardrails, A/B testing, and cost controls

GraphCanon updated Sep 12, 2026 · GitHub synced Sep 12, 2026

105views this month

256 stars35 forksLast push Sep 10, 2026 Go Apache-2.0

Decision brief

ai-gateway from Ferro Labs supports over 30 LLMs with integrated caching, guardrails, A/B testing, and cost controls, making it ideal for managing multiple language models in a production environment.

Good fit when

  • When you need to integrate more than 30 different LLM services including OpenAI and Anthropic
  • If you require extensive support for caching and rate limiting

Avoid when

  • If your project only involves one or two LLMs which does not necessitate the gateway's broad compatibility features
  • For small-scale projects that do not require comprehensive cost analysis tools

Observed Jul 17, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Very active (2d since push)
As of Sep 12, 2026
Provenance
Not a fork · Organization account
As of Sep 12, 2026
Security (OSV)
7 low (7 low)
As of Jul 15, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

go get github.com/ferro-labs/ai-gateway
pkg.go.dev

How it fits your stack(2)

Typed graph edges - alternatives, integrations, successors, and dependencies. Ranked by relationship type, not raw GitHub stars.

Relationship graph

Optional deeper exploration of typed edges and category neighbours.

Similar tools

Same-category neighbours not already linked as typed edges.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Ferro Labs' AI Gateway provides access to 30+ LLM services, including OpenAI, Anthropic, Bedrock, Azure. It supports caching, guardrail implementation, A/B testing, and cost management.

Capability facts

Languages
go

Source: github.language · Sep 12, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Node.js runtimeNode.js

Source: README excerpt (regex_v1, Sep 12, 2026)

| npm | `npm install -g ferrogw` |
Source link
Python runtimePython

Source: README excerpt (regex_v1, Sep 12, 2026)

| Python | `uv tool install ferrogw` |
Source link

Tags

README

Quick Start Under two minutes from install to first response. Platform / tool Install : : macOS, Linux Windows Homebrew Scoop then npm Python Docker Go — builds from source, without the dashboard Debian, RPM, Alpine , and packages on the releases page Then go from nothing to a se...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.