Foundry-Local
SDK and CLI for local AI inference with GPU acceleration, supporting speech-to-text models like Whisper.
GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
53views this month
Decision brief
Foundry-Local offers SDK and CLI for local GPU-accelerated AI inference, focusing on speech-to-text models such as Whisper, using ONNX Runtime.
Good fit when
- Need to run AI models locally with GPU acceleration
- Developing applications that require low-latency chat completion or speech-to-text functionalities
Avoid when
- Require cloud-based inference services for resource-intensive tasks
- Prefer using models not supported by ONNX Runtime or Whisper
- Pricing:
- freemium - Free to use SDK and CLI under MIT and Microsoft licenses, individual AI models subject to their own license terms.
Observed Jul 17, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (0d since push)
- As of Sep 20, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 20, 2026
- Security (OSV)
- No lockfile
- As of Jul 11, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Backing
Company context for Microsoft. Display-only - separate from trust and ranking.
- Company
- Microsoft·GitHub org profile·Jul 11, 2026
- Employees
- 221,000·Wikidata (P1128 employees)·Jul 11, 2026
- Commercial model
- Pure OSS·GitHub org profile (public repos)·Jul 11, 2026
Install
git clone https://github.com/microsoft/Foundry-LocalSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Provides tools for on-device AI inference using ONNX Runtime, focusing on local execution of models such as those used in chat completions.
Capability facts
- Languages
- c++
Source: github.language · Sep 20, 2026
Categories
Graph entities
Tags
README
⚖️ License Foundry Local SDK is licensed under the MIT license. For more details, see the LICENSE file. Foundry Local CLI is licensed under the Microsoft Software License Terms. For more details, read the LICENSE file. Individual models made available for use with Foundry Local a...
For agents
This page has a .md twin and JSON over the API.