pmetal logo

pmetal

Epistates/pmetal

High-performance Apple Silicon framework for LLM inference and fine-tuning

GraphCanon updated Aug 14, 2026 · GitHub synced Aug 14, 2026

29views this month

306 stars23 forksLast push Jun 5, 2026 Rust Other

Decision brief

Specializes in high-performance local Large Language Model inference and fine-tuning on Apple Silicon hardware using MLX/Metal.

Good fit when

  • For optimal performance on Apple M1-M5 series, when leveraging GPU and ANE for LLMs is crucial.
  • If Rust integration or Metal acceleration is required.

Avoid when

  • Avoid if support for Nvidia GPUs or Intel CPUs is needed.
  • Not suitable when flexibility in language models exceeds pmetal's capabilities with only specific transformer models supported natively.

Observed Jul 17, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Steady (70d since push)
As of Aug 14, 2026
Provenance
Not a fork · Organization account
As of Aug 14, 2026
Security (OSV)
No lockfile
As of Jul 15, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

cargo add pmetal
crates.io

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

PMetal offers high-performance local Large Language Model (LLM) inference, LoRA/QLoRA fine-tuning, serving, quantization, and uses MLX/Metal acceleration on Apple Silicon chips.

Capability facts

Languages
rust

Source: github.language · Aug 14, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Aug 14, 2026)

```python import pmetal
Source link

Tags

README

Quick Start (Easy API) bash git clone https://github.com/epistates/pmetal.git && cd pmetal cargo build release CLI + TUI cd crates/pmetal gui && bun install && bun tauri build GUI (optional) `` sysctl hw.packages docs/hardware support.md TrainingCallback on step start on step end...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.