MNN
Blazing-fast, lightweight inference engine for high-performance on-device LLMs and Edge AI
GraphCanon updated today · GitHub synced today
Trust & integrity
Full report- Maintenance
- Very active (2d since push)
- As of today · Source: github_public_v1
- Provenance
- Not a fork · Organization account
- As of today · Source: github_public_v1
- Security (OSV)
- No lockfile
- As of today · Source: none
Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.
Backing
Company and funding context for Alibaba. Display-only - not part of trust score or organic ranking.
- Company
- Alibaba·GitHub org profile·today
- Commercial model
- Pure OSS·GitHub org profile (public repos)·today
Overview
MNN is a powerful and efficient inference engine designed for deploying deep learning models at the edge, facilitating real-time performance on various devices.
Capability facts
- Languages
- c++
Source: github.language · Jul 11, 2026
Categories
Graph entities
Tags
README
News 🔥
- [2026/03/05] Support Qwen3.5 Series.
- [2026/02/13] MNN-Sana-Edit-V2 is now available at apps, offering cartoon-style photo editing based on Sana.
History News
- [2025/10/16] Support Qwen3-VL Series.
- [2025/06/11] New App MNN TaoAvatar released, you can talk with 3DAvatar offline with LLM, ASR, TTS, A2BS and NNR models all run local on your device!! MNN TaoAvatar
- [2025/05/12] android app support qwen2.5 omni 3b and 7b MNN Chat App.
- [2025/04/30] android app support qwen3 and dark mode MNN Chat App.
- [2025/02/18] iOS multimodal LLM App is released MNN LLM iOS.
- [2025/02/11] android app support for deepseek r1 1.5b.
- [2025/01/23] We released our full multimodal LLM Android App:MNN-LLM-Android. including text-to-text, image-to-text, audio-to-text, and text-to-image generation.
Intro
MNN is a highly efficient and lightweight deep learning framework. It supports inference and training of deep learning models and has industry-leading performance for inference and training on-device. At present, MNN has been integrated into more than 30 apps of Alibaba Inc, such as Taobao, Tmall, Youku, DingTalk, Xianyu, etc., covering more than 70 usage scenarios such as live broadcast, short video capture, search recommendation, product searching by image, interactive marketing, equity distribution, security risk control. In addition, MNN is also used on embedded devices, such as IoT.
MNN-LLM is a large language model runtime solution developed based on the MNN engine. The mission of this project is to deploy LLM models locally on everyone's platforms(Mobile Phone/PC/IOT). It supports popular large language models such as Qianwen, Baichuan, Zhipu, LLAMA, and others. [MNN-LLM