GraphCanon
Home/Data & Retrieval/REST
REST logo

REST

FasterDecoding/REST

REST: Retrieval-Based Speculative Decoding

GitHub

GraphCanon updated today · GitHub synced today

220
Stars
17
Forks
15
Open issues
6
Watchers
4mo
Last push
C Apache-2.0Created Nov 15, 2023

Trust & integrity

Full report
Maintenance
Slowing (128d since push)
As of today · Source: github_public_v1
Provenance
Not a fork · Organization account
As of today · Source: github_public_v1
Security (OSV)
2 low (2 low)
As of today · Source: osv@v1

Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.

Overview

A tool for retrieval-based speculative decoding using the C programming language, introduced in NAACL 2024.

Capability facts

Languages
c

Source: github.language · Jul 12, 2026

Categories

Data & RetrievalInference & Serving

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Jul 11, 2026)

conda create -n rest python=3.9
Source link

Tags

speculative-decodingllm-inferenceretrieval

README

Installation

conda create -n rest python=3.9
conda activate rest
pip3 install -r requirements.txt # pay attention to Pytorch CUDA version
pip3 install DraftRetriever/wheels/draftretriever-0.1.0-cp39-cp39-manylinux_2_34_x86_64.whl