kaito logo

kaito

Enrichment pending
kaito-project/kaito

Kubernetes AI Toolchain Operator

GraphCanon updated today · GitHub synced today

982
Stars
172
Forks
91
Open issues
10
Watchers
1d
Last push
Go OtherCreated Sep 9, 2023

Trust & integrity

Full report
Maintenance
Very active (1d since push)
As of today · Source: github_public_v1
Provenance
Not a fork · Organization account
As of today · Source: github_public_v1
Security (OSV)
2 low (2 low)
As of today · Source: osv@v1

Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.

Overview

Kubernetes AI Toolchain Operator

Capability facts

Languages
go, python

Source: github.language+pyproject.toml · Jul 11, 2026

Categories

Tags

README

Getting Started

  • Installation: Please check the guidance here for installing core components (Workspace, InferenceSet) using helm and here for installation using Terraform.
  • Quick Start: Please check the quick start guidance here for running your first model using KAITO!
  • AutoScaling: Please check this doc for configuring KAITO and KEDA to enable autoscaling inference workload.
  • BYO models using HuggingFace runtime: If you plan to run any BYO models using the HuggingFace runtime, check this doc. Note: KAITO only supports BYO models hosted in HuggingFace.
  • CPU models: Please check this doc for running CPU models using aikit.
  • RAGEngine: Please check the installation guidance and usage documents here.
  • RAGEngine Output Guardrails: Please check the current behavior, configuration, and limitations here.
  • Prefill/Decode Disaggregation: Please check this doc for deploying models with P/D disaggregation using MultiRoleInference and Gateway API Inference Extension.

License

See Apache License 2.0.