Home/Inference & Serving/awesome-local-llm
awesome-local-llm logo

awesome-local-llm

rafska/awesome-local-llm

Resources for running LLMs locally

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

2.9k stars388 forksLast push Sep 13, 2026 MIT

Decision brief

Unverified catalog guidance: awesome-local-llm is a curated list of resources for the local operation of large language models.

Good fit when

  • Unverified catalog guidance: - If you require extensive documentation and resources for setting up and running LLMs on your own hardware, this tool provides a comprehensive list of options
  • Unverified catalog guidance: - When aiming to self-host a large language model without relying on cloud services due to cost constraints or data privacy issues

Avoid when

  • Unverified catalog guidance: - Avoid if you seek direct tools rather than a curated list; awesome-local-llm does not provide the actual software but guidance and links
  • Unverified catalog guidance: - Not suitable for users who prefer ready-to-use solutions without needing additional configuration, as it requires self-hosting expertise to utilize its resources
Pricing:
freemium - The list itself is free and open-source under the MIT license.
Requirements:
Technical skill in setting up a self-hosted large language model environment is necessary

Observed Jul 17, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Very active (6d since push)
As of Sep 20, 2026
Provenance
Not a fork · Personal account
As of Sep 20, 2026
Security (OSV)
No lockfile
As of Jul 15, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

Package installation is not established from the available documentation. Check the source repository for setup instructions.

git clone https://github.com/rafska/awesome-local-llm
Source repository

Relationship proposals(1)

Relationship types and rationales are stored proposals, not independently verified integrations, migration guidance or endorsements.

Relationship graph

Optional deeper exploration of typed edges and category neighbours.

Relationship types and rationales are stored proposals, not independently verified integrations, migration guidance or endorsements.

Similar tools

Same-category neighbours not already linked as typed edges.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

A curated list of platforms, tools, practices and resources designed to facilitate the local operation of large language models.

Capability facts

No sourced capability facts yet. Facts appear after ingest scans repo manifests (Dockerfile, package.json, MCP configs).

Categories

Tags

README

Hardware <img src="https://img.shields.io/youtube/channel/subscribers/UCajiMK CY9icRhLepS8 3ug?style=social" height="17" align="texttop"/ Alex Ziskind tests of pcs, laptops, gpus etc. capable of running LLMs <img src="https://img.shields.io/youtube/channel/subscribers/UCiaQzXI552...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.