Home/Inference & Serving/LLM-VM

LLM-VM

anarchy-ai/LLM-VM

irresponsible innovation

GitHub Website

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

53views this month

492 stars139 forksLast push May 14, 2024 Python MIT

Decision brief

LLM-VM is a Python-based repository aimed at LLM development, highlighting tools for distillation, training, and inference.

Good fit when

When you need streamlined processes for model distillation in your project.
If rapid prototyping with local LLM deployment aligns with your goals.

Avoid when

Avoid if strict adherence to responsible AI principles is a requirement.
Not recommended for large-scale commercial deployments that necessitate stable and thoroughly validated tools.

Observed Jul 17, 2026 · Source: enrich:decision_facts

LLM-VM alternatives Trust report

Verify the decision

Maintenance and security

Full trust report

Maintenance: Dormant (858d since push); As of Sep 20, 2026
Provenance: Not a fork · Organization account; As of Sep 20, 2026
Security (OSV): No lockfile; As of Jul 11, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install LLM-VM

PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

83k★

ai-engineering-hub

Tutorials on LLMs, RAGs, and real-world AI agent applications

37k★

agents-towards-production

End-to-end, code-first tutorials for building production-grade GenAI agents

21k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

A Python-based repository for LLM development, offering tools for distillation, training, and inference.

Capability facts

Deploy: Self-host
Source: dockerfile:Dockerfile · Sep 20, 2026
Docker: Dockerfile present
Source: dockerfile:Dockerfile · Sep 20, 2026
CLI: CLI entrypoint
Source: pyproject.toml:[project.scripts] · Sep 20, 2026
Languages: python
Source: github.language+pyproject.toml · Sep 20, 2026

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Sep 20, 2026)

Python >=3.10 Supported. Older versions of Python are on a best-effort basis.

Source link

README

🥹 Requirements Installation Requirements Python =3.10 Supported. Older versions of Python are on a best effort basis. Use to check what version you are on. To upgrade your python, either create a new python env using or go to https://www.python.org/downloads/ to download the lat...

For agents

This page has a .md twin and JSON over the API.

/tools/anarchy-ai-llm-vm.md GET /api/graphcanon/tools/anarchy-ai-llm-vm GET /api/graphcanon/graph?tool=anarchy-ai-llm-vm