GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
51views this month
Decision brief
Ray-LLM is an archived project for deploying large language models on Ray, with its functionalities now integrated into the Ray framework through the ray.serve.llm and ray.data.llm APIs.
Good fit when
- If you are working with Ray and need to deploy large language models, use the ray.serve.llm and ray.data.llm APIs, which are now integrated into the Ray framework.
- For historical context or specific legacy code, you can refer to the archived repository, but be aware it is no longer maintained.
Avoid when
- Do not use the archived Ray-LLM repository for active development or deployment, as it is no longer maintained and its functionalities have been integrated into the Ray framework.
- If you require the latest features and support for deploying large language models, avoid the archived repository and use the ray.serve.llm and ray.data.llm APIs directly.
- Pricing:
- unknown - Pricing details are not available.
- Requirements:
- Ensure you have the latest version of Ray installed to use the ray.serve.llm and ray.data.llm APIs.
Observed Sep 18, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Archived (554d since push)
- As of Sep 18, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 18, 2026
- Security (OSV)
- No lockfile
- As of Sep 18, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
git clone https://github.com/ray-project/ray-llmSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
RayLLM was a project for deploying large language models on Ray. The project is archived, with its functionalities now integrated into the Ray framework through the ray.serve.llm and ray.data.llm APIs.
Capability facts
No sourced capability facts yet. Facts appear after ingest scans repo manifests (Dockerfile, package.json, MCP configs).
Categories
Tags
README
Ray LLM APIs are now upstreamed and moved to Ray Repo This repository has been archived and is no longer maintained. We have created and APIs to simplify deployment of LLMs on top of Ray. These APIs are now directly integrated into Ray and managed by the Ray team. The history of...
For agents
This page has a .md twin and JSON over the API.