Home/Inference & Serving/openmodelz

openmodelz

tensorchord/openmodelz

Automate and scale inference of large language models on Kubernetes.

GitHub Website

GraphCanon updated Sep 29, 2026 · GitHub synced Sep 29, 2026

59views this month

284 stars26 forksLast push Nov 3, 2023 Go Apache-2.0

Decision brief

OpenModelZ automates and scales large language model inferences on Kubernetes.

Good fit when

When you need automatic scaling of large language models based on current load on Kubernetes clusters.
If you require deploying custom applications with an emphasis on ease-of-use for managing LLM inferences.

Avoid when

Avoid using if your deployment setup does not include Kubernetes or another cluster management system that OpenModelZ supports.
Do not use this tool if you do not need automatic scaling features, as manual setup might be more straightforward for simpler deployments.

Observed Jul 16, 2026 · Source: enrich:decision_facts

openmodelz alternatives Trust report

Verify the decision

Maintenance and security

Full trust report

Maintenance: Dormant (1060d since push); As of Sep 29, 2026
Provenance: Not a fork · Organization account; As of Sep 29, 2026
Security (OSV): 106 low (106 low); As of Jul 11, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Backing

Company context for TensorChord. Display-only - separate from trust and ranking.

Company: TensorChord·GitHub org profile·Jul 11, 2026
Commercial model: Pure OSS·GitHub org profile (public repos)·Jul 11, 2026

Install

go get github.com/tensorchord/openmodelz

pkg.go.dev

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

omlx

LLM inference server with continuous batching and SSD caching for Apple Silicon

22k★

whichllm

Command-line tool to find and benchmark local LLM performance

6.7k★

kserve

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

6.0k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

OpenModelZ is a tool designed to ease the deployment, scaling, and management of large language model inferences on clusters managed by Kubernetes or other systems. It supports automatic scaling of deployments based on current load and provides features for deploying custom applications.

Capability facts

CLI: CLI entrypoint
Source: pyproject.toml:[project.scripts] · Sep 29, 2026
Languages: go, python
Source: github.language+pyproject.toml · Sep 29, 2026

Graph entities

TensorChordcompany

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Sep 29, 2026)

1 root 0:00 /usr/bin/dumb-init /bin/sh -c python3 -m http.server 80

Source link

README

Install You can install OpenModelZ using the following command: You could verify the installation by running the following command: Once you've installed the you can start deploying models and experimenting with them. Create your first UI based deployment Once you've bootstrapped...

For agents

This page has a .md twin and JSON over the API.

/tools/tensorchord-openmodelz.md GET /api/graphcanon/tools/tensorchord-openmodelz GET /api/graphcanon/graph?tool=tensorchord-openmodelz