xllm logo

xllm

xLLM-AI/xllm

A high-performance inference engine for LLM, VLM, DiT and REC models

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

63views this month

1.6k stars300 forksLast push Sep 19, 2026 C++ Apache-2.0

Decision brief

A high-performance inference engine for LLM, VLM, DiT, and REC models by the OpenAtom Foundation.

Good fit when

  • When developing applications that require optimized performance on various AI accelerators
  • For projects involving deepseek, glm, Qwen large language models

Avoid when

  • If your project strictly requires Python-based inference engines for backend support
  • In cases preferring proprietary licenses over the Apache-2.0 open-source framework used here

Observed Jul 14, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Very active (0d since push)
As of Sep 19, 2026
Provenance
Not a fork · Organization account
As of Sep 19, 2026
Security (OSV)
No lockfile
As of Jul 11, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

git clone https://github.com/xLLM-AI/xllm

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Hosted by the OpenAtom Foundation, this C++-based repository offers optimized performances across diverse AI accelerators.

Capability facts

CLI
CLI entrypoint

Source: pyproject.toml:[project.scripts] · Sep 19, 2026

Languages
c++, python

Source: github.language+pyproject.toml · Sep 19, 2026

Categories

Tags

README

Hardware Support Hardware Abbreviation Example Remark Ascend NPU NPU A2, A3 HDK Driver 25.2.0 + Cambricon MLU MLU MLU Moore Threads GPU MUSA S5000 Hygon DCU DCU BW1000 MetaX MACA MACA MXC500 Iluvatar CoreX GPU ILU BI150 Getting Started Quick Start Launch xLLM Online Service Offli...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.