Awesome-Multimodal-Large-Language-Models
BradyFU/Awesome-Multimodal-Large-Language-Models
:sparkles::sparkles:Latest Advances on Multimodal Large Language Models
:sparkles::sparkles:Latest Advances on Multimodal Large Language Models
Categories
Tags
Similar tools
ollama
ollama/ollama
Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
prompts.chat
f/prompts.chat
The world's largest open-source prompt library for AI
transformers
huggingface/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models
open-webui
open-webui/open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
awesome-llm-apps
Shubhamsaboo/awesome-llm-apps
100+ AI Agent & RAG apps you can actually run — clone, customize, ship.
LLMs-from-scratch
rasbt/LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch
Install
git clone https://github.com/BradyFU/Awesome-Multimodal-Large-Language-ModelsREADME
Awesome-Multimodal-Large-Language-Models
✨ Highlights of NJU-MiG
🔥🔥 Surveys of MLLMs | 💬 WeChat (MLLM微信交流群)
-
🌟 MME-Survey: A Comprehensive Survey on Evaluation of Multimodal LLMs
arXiv 2025, Paper, Project -
🌟 A Survey of Unified Multimodal Understanding and Generation: Advances and Challenges
arXiv 2025, Paper, Project -
A Survey on Multimodal Large Language Models
NSR 2024, Paper, Project
🔥🔥 VITA Series Omni MLLMs | 💬 WeChat (VITA微信交流群)
-
VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction
NeurIPS 2025 Highlight, Paper, Project -
VITA: Towards Open-Source Interactive Omni Multimodal LLM
arXiv 2024, Paper, Project -
VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Model
NeurIPS 2025, Paper, Project
🔥🔥 MME Series MLLM Benchmarks
- 🔥 Video-MME-v2: Towards the Next Stage in Video Understanding Evaluation
-
🌟 MME-Survey: A Comprehensive Survey on Evaluation of Multimodal LLMs
arXiv 2025, Paper, Project -
MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models
NeurIPS 2025 DB Highlight, Paper, Dataset, Eval Tool, ✒️ Citation -
Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis
CVPR 2025, Paper, Project, Dataset
Table of Contents
- Awesome Papers
- Multimodal Instruction Tuning (& Latest Works)
- Multimodal Hallucination
- Multimodal In-Context Learning
- Multimodal Chain-of-Thought
- LLM-Aided Visual Reasoning
- Foundation Models
- Evaluation
- Multimodal RLHF
- Others
- Awesome Datasets
- Datasets of Pre-Training for Alignment
- Datasets of Multimodal Instruction Tuning
- Datasets of In-Context Learning
- [Datasets of Multimod