“edge-ai”

cactus

Low-latency AI engine for mobile devices & wearables

FedML

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on a

off-grid-ai-mobile

The Swiss Army Knife of Offline AI

NanoLLM

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.