modelz-llm logo

modelz-llm

tensorchord/modelz-llm

OpenAI compatible API for LLMs and embeddings

GraphCanon updated 2w · GitHub synced 2w · 25 views this month

276 stars27 forksLast push 2y Python Apache-2.0

Decision brief

Modelz-llm provides an OpenAI-compatible API for working with diverse language models and embeddings like LLaMA, Vicuna, ChatGLM without requiring direct integration with each model's custom APIs.

Good fit when

  • When developers aim to implement multiple large language models within applications using a single consistent interface compatible with the OpenAI API schema
  • If there is a need for rapid experimentation across different pre-trained models such as LLaMA, Vicuna, or ChatGLM without additional integrations

Avoid when

  • Avoid if your project specifically requires proprietary features only available in individual model APIs that are not covered by the OpenAI API compatibility offered by Modelz-llm
  • If real-time updates to bleeding-edge models matter more than ease of integration, since Modelz-llm may lag slightly behind in updating its supported model versions

Observed Jul 17, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Dormant (1025d since push)
As of 2w
Provenance
Not a fork · Organization account
As of 2w
Security (OSV)
No criticals
As of 1mo

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Backing

Company context for TensorChord. Display-only - separate from trust and ranking.

Company
TensorChord·GitHub org profile·1mo
Commercial model
Pure OSS·GitHub org profile (public repos)·1mo

Install

pip install modelz-llm
PyPI

How it fits your stack(1)

Typed graph edges - alternatives, integrations, successors, and dependencies. Ranked by relationship type, not raw GitHub stars.

Relationship graph

Optional deeper exploration of typed edges and category neighbours.

Similar tools

Same-category neighbours not already linked as typed edges.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Modelz-llm provides an OpenAI compatible API for working with Language Models and embeddings including support for models such as LLaMA, Vicuna, ChatGLM among others.

Capability facts

CLI
CLI entrypoint

Source: pyproject.toml:[project.scripts] · Aug 2, 2026

Languages
python

Source: github.language+pyproject.toml · Aug 2, 2026

Categories

Graph entities

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Aug 2, 2026)

pip install modelz-llm
Source link

Tags

README

Install

pip install modelz-llm

---

# or install from source
pip install git+https://github.com/tensorchord/modelz-llm.git[gpu]

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.