GraphCanon updated 2d · GitHub synced 2d
3.0k stars246 forksLast push 1mo C++ MIT
Decision brief
distributed-llama is a C++ framework that leverages multiple home devices for faster large language model inference, under the MIT license.
Good fit when
- When you have multiple interconnected home devices and want to maximize their combined computing power for LLM inference tasks.
- If your use case involves real-time or near-real-time responses where performance acceleration is critical.
Avoid when
- For scenarios with fewer than two available devices, as the framework's capability to distribute and boost performance would be limited.
- In professional environments that require strict data privacy controls, due to potential network vulnerabilities among home devices.
Observed Jul 17, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Steady (50d since push)
- As of 2d
- Provenance
- Not a fork · Personal account
- As of 2d
- Security (OSV)
- No lockfile
- As of 1mo
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
git clone https://github.com/b4rtaz/distributed-llamaSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
A framework for distributing large language model inference across multiple connected home devices to boost performance
Capability facts
- Languages
- c++
Source: github.language · Aug 24, 2026
Categories
Tags
README
💡 License
This project is released under the MIT license.
For agents
This page has a .md twin and JSON over the API.