FlexLLMGen
Running large language models on a single GPU for throughput-oriented scenarios.
GraphCanon updated today · GitHub synced today
9.4k
Stars
589
Forks
58
Open issues
5
Watchers
1y
Last push
Python Apache-2.0Created Feb 15, 2023
Trust & integrity
Full report- Maintenance
- Archived (621d since push)
- As of today · Source: github_public_v1
- Provenance
- Not a fork · Organization account
- As of today · Source: github_public_v1
- Security (OSV)
- No lockfile
- As of today · Source: none
Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.
Overview
A Python-based tool designed to run large language models with high throughput using a single GPU, focusing on offloading tasks efficiently.
Capability facts
- Languages
- python
Source: github.language+pyproject.toml · Jul 12, 2026