GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
58views this month
Decision brief
KubeAI is an AI inference operator for Kubernetes that simplifies the deployment and scaling of machine learning models, including LLMs, embeddings, and speech-to-text services, with intelligent scaling and optimized for
Good fit when
- you need to deploy and scale machine learning models on Kubernetes, especially LLMs, embeddings, and speech-to-text services
- you require intelligent scaling and optimized routing for large-scale deployments
Avoid when
- you are looking for a solution that requires additional systems like Istio or Knative for scale-from-zero
- you need a tool that heavily relies on Prometheus metrics adapter for autoscaling
- Pricing:
- freemium - The tool is free and open-source under the Apache-2.0 license, but additional services or support might incur costs
- Requirements:
- Min 4 GB RAM; Requires Docker; Requires a Kubernetes cluster; Supports deployment on CPU, GPU, or TPU hardware
Observed Sep 18, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (0d since push)
- As of Sep 18, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 18, 2026
- Security (OSV)
- 41 low (41 low)
- As of Sep 18, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
go get github.com/kubeai-project/kubeai pkg.go.devSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
KubeAI is an AI inference operator for Kubernetes that simplifies the deployment and scaling of machine learning models, including LLMs, embeddings, and speech-to-text services.
Capability facts
- Deploy
- Self-host
Source: dockerfile:Dockerfile · Sep 18, 2026
- Docker
- Dockerfile present
Source: dockerfile:Dockerfile · Sep 18, 2026
- Languages
- go
Source: github.language · Sep 18, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (regex_v1, Sep 18, 2026)
### OpenAI API CompatibilitySource link
Tags
README
KubeAI: AI Inferencing Operator <p align="left" <img src="https://img.shields.io/github/license/kubeai project/kubeai"/ <img src="https://img.shields.io/github/go mod/go version/kubeai project/kubeai"/ <img src="https://img.shields.io/github/stars/kubeai project/kubeai"/ <img src...
For agents
This page has a .md twin and JSON over the API.