GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
25views this month
Decision brief
REST is a retrieval-based speculative decoding method for enhancing the efficiency of large language model inference, implemented in C under the Apache-2.0 license.
Good fit when
- Use REST when you need to improve the efficiency of large language model inference through retrieval-based speculative decoding.
- Consider REST if your project requires a method that can handle large language models with improved speed and efficiency, and you are working with the C language.
Avoid when
- Avoid REST if your project does not require improvements in the efficiency of large language model inference.
- Do not use REST if your project is not compatible with the C language or if you prefer a different license than Apache-2.0.
Observed Sep 18, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Slowing (196d since push)
- As of Sep 18, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 18, 2026
- Security (OSV)
- 4 low (4 low)
- As of Sep 18, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
git clone https://github.com/FasterDecoding/RESTSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
A retrieval-based speculative decoding method for improving the efficiency of large language model inference.
Capability facts
- Languages
- c
Source: github.language · Sep 18, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (regex_v1, Sep 18, 2026)
conda create -n rest python=3.9Source link
Tags
README
Installation
For agents
This page has a .md twin and JSON over the API.