---
title: "Foundry-Local vs awesome-local-llm"
type: "comparison"
canonical_url: "https://www.graphcanon.com/compare/microsoft-foundry-local-vs-rafska-awesome-local-llm"
tools: ["microsoft-foundry-local", "rafska-awesome-local-llm"]
---

# Foundry-Local vs awesome-local-llm

*GraphCanon updated Aug 12, 2026*

## Verdict

Pick Foundry-Local if foundry-Local offers SDK and CLI for local GPU-accelerated AI inference, focusing on speech-to-text models such as Whisper, using ONNX Runtime; pick awesome-local-llm if awesome-local-llm is a curated list of resources for the local operation of large language models.

[Foundry-Local](https://foundrylocal.ai) reports 2.5k GitHub stars, 348 forks, and 71 open issues, last pushed Jul 30, 2026. [awesome-local-llm](https://github.com/rafska/awesome-local-llm) has 2.5k stars, 316 forks, and 129 open issues, last pushed Aug 4, 2026. Figures are from public GitHub metadata via [Foundry-Local's repository](https://github.com/microsoft/Foundry-Local) and [awesome-local-llm's repository](https://github.com/rafska/awesome-local-llm).

| | [Foundry-Local](/tools/microsoft-foundry-local.md) | [awesome-local-llm](/tools/rafska-awesome-local-llm.md) |
| --- | --- | --- |
| Tagline | SDK and CLI for local AI inference with GPU acceleration, supporting speech-to-text models like Whisper. | Resources for running LLMs locally |
| Stars | 2,479 | 2,518 |
| Forks | 348 | 316 |
| Open issues | 71 | 129 |
| Language | C++ | - |
| Adopt for | Foundry-Local offers SDK and CLI for local GPU-accelerated AI inference, focusing on speech-to-text models such as Whisper, using ONNX Runtime. | awesome-local-llm is a curated list of resources for the local operation of large language models. |
| Persona | - | - |
| Runtime | - | - |
| License | SDK is licensed under the MIT License. The CLI uses the Microsoft Software License Terms. Models available with Foundry-Local are individually licensed as per their documentation or download page. | MIT License |
| Categories | Inference & Serving, Speech & Audio | Inference & Serving |

## Trust and health

_Sourced signals - not a safety guarantee. No winner column._

| | [Foundry-Local](/tools/microsoft-foundry-local.md) | [awesome-local-llm](/tools/rafska-awesome-local-llm.md) |
| --- | --- | --- |
| Maintenance | Very active (96%) | Active (82%) |
| Days since push | 0d | 7d |
| Open issues (now) | 71 | 129 |
| Owner type | Organization | User |
| Full report | [trust report](/tools/microsoft-foundry-local/trust.md) | [trust report](/tools/rafska-awesome-local-llm/trust.md) |

## Decision facts: Foundry-Local

- **Pricing:** freemium - Free to use SDK and CLI under MIT and Microsoft licenses, individual AI models subject to their own license terms.
- **Adopt for:** Foundry-Local offers SDK and CLI for local GPU-accelerated AI inference, focusing on speech-to-text models such as Whisper, using ONNX Runtime.
- **License detail:** SDK is licensed under the MIT License. The CLI uses the Microsoft Software License Terms. Models available with Foundry-Local are individually licensed as per their documentation or download page.

## Decision facts: awesome-local-llm

- **Pricing:** freemium - The list itself is free and open-source under the MIT license.
- **Requirements:** Technical skill in setting up a self-hosted large language model environment is necessary
- **Adopt for:** awesome-local-llm is a curated list of resources for the local operation of large language models.
- **License detail:** MIT License

## Choose when

### Choose Foundry-Local if…

- License: Foundry-Local is Other, awesome-local-llm is MIT.
- Pricing: Free to use SDK and CLI under MIT and Microsoft licenses, individual AI models subject to their own license terms..
- Tags unique to Foundry-Local: ai-sdk, chat-completions, foundry-local, gpu acceleration.
- Also covers Speech & Audio.
- Need to run AI models locally with GPU acceleration

### Choose awesome-local-llm if…

- License: awesome-local-llm is MIT, Foundry-Local is Other.
- Pricing: The list itself is free and open-source under the MIT license..
- Requirements: Technical skill in setting up a self-hosted large language model environment is necessary.
- Tags unique to awesome-local-llm: ai, awesome-list, llm, self-hosted.
- - If you require extensive documentation and resources for setting up and running LLMs on your own hardware, this tool provides a comprehensive list of options

## When NOT to use Foundry-Local

- Require cloud-based inference services for resource-intensive tasks
- Prefer using models not supported by ONNX Runtime or Whisper

## When NOT to use awesome-local-llm

- - Avoid if you seek direct tools rather than a curated list; awesome-local-llm does not provide the actual software but guidance and links
- - Not suitable for users who prefer ready-to-use solutions without needing additional configuration, as it requires self-hosting expertise to utilize its resources

## Common questions

### What is the difference between Foundry-Local and awesome-local-llm?

Foundry-Local: SDK and CLI for local AI inference with GPU acceleration, supporting speech-to-text models like Whisper.. awesome-local-llm: Resources for running LLMs locally. See the comparison table for live GitHub stats and shared categories.

### When should I choose Foundry-Local over awesome-local-llm?

Choose Foundry-Local over awesome-local-llm when License: Foundry-Local is Other, awesome-local-llm is MIT; Pricing: Free to use SDK and CLI under MIT and Microsoft licenses, individual AI models subject to their own license terms.; Tags unique to Foundry-Local: ai-sdk, chat-completions, foundry-local, gpu acceleration; Also covers Speech & Audio; Need to run AI models locally with GPU acceleration.

### When should I choose awesome-local-llm over Foundry-Local?

Choose awesome-local-llm over Foundry-Local when License: awesome-local-llm is MIT, Foundry-Local is Other; Pricing: The list itself is free and open-source under the MIT license.; Requirements: Technical skill in setting up a self-hosted large language model environment is necessary; Tags unique to awesome-local-llm: ai, awesome-list, llm, self-hosted; - If you require extensive documentation and resources for setting up and running LLMs on your own hardware, this tool provides a comprehensive list of options.

### When should I avoid Foundry-Local?

Require cloud-based inference services for resource-intensive tasks Prefer using models not supported by ONNX Runtime or Whisper

### When should I avoid awesome-local-llm?

- Avoid if you seek direct tools rather than a curated list; awesome-local-llm does not provide the actual software but guidance and links - Not suitable for users who prefer ready-to-use solutions without needing additional configuration, as it requires self-hosting expertise to utilize its resources

### Is Foundry-Local or awesome-local-llm more popular on GitHub?

awesome-local-llm has more GitHub stars (2,518 vs 2,479). Stars measure visibility, not whether either tool fits your constraints.

### Are Foundry-Local and awesome-local-llm open source?

Yes - both are open-source projects on GitHub (Foundry-Local: Other, awesome-local-llm: MIT).

### Where can I find alternatives to Foundry-Local or awesome-local-llm?

GraphCanon lists graph-backed alternatives at [Foundry-Local alternatives](/tools/microsoft-foundry-local/alternatives) and [awesome-local-llm alternatives](/tools/rafska-awesome-local-llm/alternatives) ([Foundry-Local markdown twin](/tools/microsoft-foundry-local/alternatives.md), [awesome-local-llm markdown twin](/tools/rafska-awesome-local-llm/alternatives.md)), ranked by typed relationship edges rather than popularity votes.

### Is there a machine-readable version of this comparison?

Yes. The markdown twin at [this comparison](/compare/microsoft-foundry-local-vs-rafska-awesome-local-llm.md) mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers.

### Which is better maintained, Foundry-Local or awesome-local-llm?

Foundry-Local: Very active. awesome-local-llm: Active. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance.

### Where are the full trust reports for Foundry-Local and awesome-local-llm?

GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: [Foundry-Local trust report](/tools/microsoft-foundry-local/trust); [awesome-local-llm trust report](/tools/rafska-awesome-local-llm/trust).

---

**Machine-readable endpoints**

- JSON: [`/api/graphcanon/graph?tool=microsoft-foundry-local`](/api/graphcanon/graph?tool=microsoft-foundry-local)
- LLM index: [/llms.txt](/llms.txt)
- Full corpus: [/llms-full.txt](/llms-full.txt)

_GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_