“metal”

Wax

Single-file memory layer for AI agents, sub mili-second RAG on Apple Silicon. Metal Optimized On-Device. No Server. No API. One File. Pure Swift

dstack

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

tvm

Open Machine Learning Compiler Framework

LLMKube

Kubernetes operator for self-hosted LLM inference across various GPU types

RCLI

Talk to your Mac, query your docs, no cloud required. On-device voice AI + RAG