Home/Inference & Serving/omlx

omlx

Enrichment pending

jundot/omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon, managed from the macOS menu bar

GitHub Website

GraphCanon updated today · GitHub synced today

18k stars1.5k forksLast push today Python Apache-2.0

omlx alternatives Trust report

Verify the decision

Maintenance and security

Full trust report

Maintenance: Very active (0d since push); As of today
Provenance: Not a fork · Personal account; As of today
Security (OSV): No lockfile; As of today

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install omlx

PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on.

185k★

ollama

Get up and running with various large language models using Ollama.

176k★

prompts.chat

Share, discover, and collect prompts from the community

165k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Capability facts

CLI: CLI entrypoint
Source: pyproject.toml:[project.scripts] · Jul 15, 2026
Languages: python
Source: github.language+pyproject.toml · Jul 15, 2026

README

Managed background server (macOS app or Homebrew install)

omlx start omlx stop omlx restart

For agents

This page has a .md twin and JSON over the API.

/tools/jundot-omlx.md GET /api/graphcanon/tools/jundot-omlx GET /api/graphcanon/graph?tool=jundot-omlx