GraphCanon updated 2w · GitHub synced 2w
Decision brief
Archived LLM deployment tool integrated into Ray; now focus on built-in APIs (`ray.serve.llm` & `ray.data.llm`).
Good fit when
- For deploying LLMs with new Ray-integrated APIs, ensuring direct support and updates from the Ray team.
- If using Ray as ecosystem base for model serving or training, integrating modern Ray capabilities.
Avoid when
- If seeking a standalone solution distinct from Ray’s main project, preferring specialized tools.
- For needs requiring active maintenance and development in this specific repository; consider alternative up-to-date projects.
Observed Jul 12, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Archived (507d since push)
- As of 2w
- Provenance
- Not a fork · Organization account
- As of 2w
- Security (OSV)
- No lockfile
- As of 1mo
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
git clone https://github.com/ray-project/ray-llmSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Formerly known as RayLLM, this archived repository moved its efforts to integrate Large Language Model (LLM) deployment capabilities directly into the main Ray project through new APIs.
Capability facts
No sourced capability facts yet. Facts appear after ingest scans repo manifests (Dockerfile, package.json, MCP configs).
Categories
Tags
README
Ray LLM APIs are now upstreamed and moved to Ray Repo
This repository has been archived and is no longer maintained. We have created ray.serve.llm and ray.data.llm APIs to simplify deployment of LLMs on top of Ray. These APIs are now directly integrated into Ray and managed by the Ray team. The history of this repository is moved to archived-master branch only for historical context.
For agents
This page has a .md twin and JSON over the API.