{"data":{"slug":"kaito-project-kaito","name":"kaito","tagline":"Kubernetes AI Toolchain Operator","github_url":"https://github.com/kaito-project/kaito","owner":"kaito-project","repo":"kaito","owner_avatar_url":"https://avatars.githubusercontent.com/u/186863079?v=4","primary_language":"Go","stars":982,"forks":172,"topics":["ai","gpu","kubernetes","operator"],"archived":false,"github_pushed_at":"2026-07-10T08:42:51+00:00","maintenance_label":"Very active","url":"https://www.graphcanon.com/tools/kaito-project-kaito","markdown_url":"https://www.graphcanon.com/tools/kaito-project-kaito.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/kaito-project-kaito","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=kaito-project-kaito","description":"Kubernetes AI Toolchain Operator","homepage_url":"https://kaito-project.github.io/kaito/docs/","license":"Other","open_issues":91,"watchers":10,"ai_summary":null,"readme_excerpt":"## Getting Started \n- **Installation**: Please check the guidance [here](https://kaito-project.github.io/kaito/docs/installation) for installing core components (Workspace, InferenceSet) using helm and [here](https://github.com/kaito-project/kaito/blob/main/terraform/README.md) for installation using Terraform.\n- **Quick Start**: Please check the quick start guidance [here](https://kaito-project.github.io/kaito/docs/quick-start) for running your first model using KAITO!\n- **AutoScaling**: Please check this [doc](https://kaito-project.github.io/kaito/docs/keda-autoscaler-inference) for configuring KAITO and KEDA to enable autoscaling inference workload.\n- **BYO models using HuggingFace runtime**: If you plan to run any BYO models using the HuggingFace runtime, check this [doc](https://kaito-project.github.io/kaito/docs/custom-model). Note: KAITO only supports BYO models hosted in HuggingFace.\n- **CPU models**: Please check this [doc](https://kaito-project.github.io/kaito/docs/aikit) for running CPU models using [aikit](https://github.com/kaito-project/aikit/).\n- **RAGEngine**: Please check the installation guidance and usage documents [here](https://kaito-project.github.io/kaito/docs/rag).\n- **RAGEngine Output Guardrails**: Please check the current behavior, configuration, and limitations [here](https://kaito-project.github.io/kaito/docs/rag-output-guardrails).\n- **Prefill/Decode Disaggregation**: Please check this [doc](https://kaito-project.github.io/kaito/docs/prefill-decode-disaggregation) for deploying models with P/D disaggregation using MultiRoleInference and Gateway API Inference Extension.\n\n---\n\n## License\n\nSee [Apache License 2.0](LICENSE).","github_created_at":"2023-09-09T01:53:38+00:00","created_at":"2026-07-11T23:13:28.18533+00:00","updated_at":"2026-07-11T23:13:46.311837+00:00","categories":[{"slug":"llm-frameworks","name":"LLM Frameworks","url":"https://www.graphcanon.com/categories/llm-frameworks","markdown_url":"https://www.graphcanon.com/categories/llm-frameworks.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/llm-frameworks"},{"slug":"developer-tools","name":"Developer Tools","url":"https://www.graphcanon.com/categories/developer-tools","markdown_url":"https://www.graphcanon.com/categories/developer-tools.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/developer-tools"},{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"}],"tags":[{"slug":"go","name":"go"},{"slug":"operator","name":"operator"},{"slug":"gpu","name":"gpu"},{"slug":"ai","name":"ai"},{"slug":"kubernetes","name":"kubernetes"}],"trust":{"provenance":{"is_fork":false,"github_id":689172674,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-07-11T23:13:29.789Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":3,"days_since_push":1,"last_release_at":"2026-07-01T04:21:06Z"},"security_summary":{"status":"findings","scanner":"osv@v1","low_count":2,"high_count":0,"last_scan_at":"2026-07-11T23:13:30.158Z","medium_count":0,"scan_profile":"deps","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-07-11T23:13:29.564Z"},"languages":{"value":["go","python"],"source":"github.language+pyproject.toml","observed_at":"2026-07-11T23:13:29.564Z"},"license_spdx":{"value":"Other","source":"github.license","observed_at":"2026-07-11T23:13:29.564Z"}}}}