kserve

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

GitHub Website

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

65views this month

6.0k stars1.7k forksLast push Sep 19, 2026 Go Apache-2.0

Decision brief

Good fit when

When you need a standardized and scalable way to deploy generative and predictive models across multiple frameworks.
If your existing infrastructure is built around Kubernetes, as kserve/kserve is tightly integrated with it for efficient deployment.

Avoid when

When your team or organization lacks expertise in Kubernetes, as effective use of kserve/kserve requires familiarity with Kubernetes operations.
If the deployment environment is not compatible with Kubernetes. KServe's architecture relies on the Kubernetes ecosystem for orchestrating model deployments.

Requirements:: Requires Docker; Requires a Kubernetes cluster to run.

Observed Jul 12, 2026 · Source: enrich:decision_facts

kserve alternatives Trust report

Verify the decision

Maintenance and security

Full trust report

Maintenance: Very active (0d since push); As of Sep 19, 2026
Provenance: Not a fork · Organization account; As of Sep 19, 2026
Security (OSV): No lockfile; As of Jul 11, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

go get github.com/kserve/kserve

pkg.go.dev

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

skypilot

Run, manage, and scale AI workloads on any AI infrastructure.

11k★

BentoML

The easiest way to serve AI apps and models

8.8k★

dynamo

A Datacenter Scale Distributed Inference Serving Framework

8.1k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

kserve/kserve provides a scalable inference platform for deploying generative and predictive models across multiple frameworks using Kubernetes.

Capability facts

Deploy: Self-host
Source: dockerfile:Dockerfile · Sep 19, 2026
Docker: Dockerfile present
Source: dockerfile:Dockerfile · Sep 19, 2026
Languages: go
Source: github.language · Sep 19, 2026

README

:hammer and wrench: Installation Standalone Installation Standard Kubernetes Installation : Compared to Serverless Installation, this is a more lightweight installation. However, this option does not support canary deployment and request based autoscaling with scale to zero. Knat...

For agents

This page has a .md twin and JSON over the API.

/tools/kserve-kserve.md GET /api/graphcanon/tools/kserve-kserve GET /api/graphcanon/graph?tool=kserve-kserve