distributed-llama
Enrichment pendingDistributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
GraphCanon updated today · GitHub synced today
3.0k
Stars
238
Forks
48
Open issues
50
Watchers
6d
Last push
C++ MITCreated Dec 4, 2023
Trust & integrity
Full report- Maintenance
- Very active (5d since push)
- As of today · Source: github_public_v1
- Provenance
- Not a fork · Personal account
- As of today · Source: github_public_v1
- Security (OSV)
- No lockfile
- As of today · Source: none
Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.
Overview
Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Capability facts
- Languages
- c++
Source: github.language · Jul 11, 2026