kubeai logo

kubeai

kubeai-project/kubeai

AI Inference Operator for Kubernetes

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

58views this month

1.3k stars137 forksLast push Sep 17, 2026 Go Apache-2.0

Decision brief

KubeAI is an AI inference operator for Kubernetes that simplifies the deployment and scaling of machine learning models, including LLMs, embeddings, and speech-to-text services, with intelligent scaling and optimized for

Good fit when

  • you need to deploy and scale machine learning models on Kubernetes, especially LLMs, embeddings, and speech-to-text services
  • you require intelligent scaling and optimized routing for large-scale deployments

Avoid when

  • you are looking for a solution that requires additional systems like Istio or Knative for scale-from-zero
  • you need a tool that heavily relies on Prometheus metrics adapter for autoscaling
Pricing:
freemium - The tool is free and open-source under the Apache-2.0 license, but additional services or support might incur costs
Requirements:
Min 4 GB RAM; Requires Docker; Requires a Kubernetes cluster; Supports deployment on CPU, GPU, or TPU hardware

Observed Sep 18, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Very active (0d since push)
As of Sep 18, 2026
Provenance
Not a fork · Organization account
As of Sep 18, 2026
Security (OSV)
41 low (41 low)
As of Sep 18, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

go get github.com/kubeai-project/kubeai
pkg.go.dev

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

KubeAI is an AI inference operator for Kubernetes that simplifies the deployment and scaling of machine learning models, including LLMs, embeddings, and speech-to-text services.

Capability facts

Deploy
Self-host

Source: dockerfile:Dockerfile · Sep 18, 2026

Docker
Dockerfile present

Source: dockerfile:Dockerfile · Sep 18, 2026

Languages
go

Source: github.language · Sep 18, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

OpenAI APIOpenAI API

Source: README excerpt (regex_v1, Sep 18, 2026)

### OpenAI API Compatibility
Source link

Tags

README

KubeAI: AI Inferencing Operator <p align="left" <img src="https://img.shields.io/github/license/kubeai project/kubeai"/ <img src="https://img.shields.io/github/go mod/go version/kubeai project/kubeai"/ <img src="https://img.shields.io/github/stars/kubeai project/kubeai"/ <img src...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.