Foundry-Local
SDK and CLI for local AI inference with GPU acceleration, supporting speech-to-text models like Whisper.
GraphCanon updated 3w · GitHub synced 3w
Decision brief
Foundry-Local offers SDK and CLI for local GPU-accelerated AI inference, focusing on speech-to-text models such as Whisper, using ONNX Runtime.
Good fit when
- Need to run AI models locally with GPU acceleration
- Developing applications that require low-latency chat completion or speech-to-text functionalities
Avoid when
- Require cloud-based inference services for resource-intensive tasks
- Prefer using models not supported by ONNX Runtime or Whisper
- Pricing:
- freemium - Free to use SDK and CLI under MIT and Microsoft licenses, individual AI models subject to their own license terms.
Observed Jul 17, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (0d since push)
- As of 3w
- Provenance
- Not a fork · Organization account
- As of 3w
- Security (OSV)
- No lockfile
- As of 1mo
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Backing
Company context for Microsoft. Display-only - separate from trust and ranking.
- Company
- Microsoft·GitHub org profile·1mo
- Employees
- 221,000·Wikidata (P1128 employees)·1mo
- Commercial model
- Pure OSS·GitHub org profile (public repos)·1mo
Install
git clone https://github.com/microsoft/Foundry-LocalSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Provides tools for on-device AI inference using ONNX Runtime, focusing on local execution of models such as those used in chat completions.
Capability facts
- Languages
- c++
Source: github.language · Jul 30, 2026
Categories
Graph entities
Tags
README
⚖️ License
Foundry Local SDK is licensed under the MIT license. For more details, see the LICENSE file. Foundry Local CLI is licensed under the Microsoft Software License Terms. For more details, read the LICENSE file.
Individual models made available for use with Foundry Local are subject to the each model's license terms, notices, and use restrictions. Refer to the model's documentation or download/listing page for the applicable terms before using or redistributing a model.
For agents
This page has a .md twin and JSON over the API.