NExT-GPT logo

NExT-GPT

NExT-GPT/NExT-GPT

Code and models for ICML 2024 paper on multimodal large language model

GraphCanon updated 4d · GitHub synced 4d · 43 views this month

3.6k stars359 forksLast push 1y Python BSD-3-Clause

Decision brief

NExT-GPT is focused on multimodal capabilities and instruction tuning for a large language model, targeting researchers and developers interested in multimodal applications.

Good fit when

  • - If you are conducting research specifically centered around multimodal interactions (combining text with visual elements) aligning with the scope of NExT-GPT.
  • - For projects requiring integration or further development on top of an existing Any-to-Any Multimodal Large Language Model that leverages instruction-tuning techniques.

Avoid when

  • - When your project necessitates a production-ready solution, as NExT-GPT is positioned purely for research and non-commercial use.
  • - If your application requires the model to be used in contexts like illegal, harmful, violent, racist, or sexual purposes, since its usage guidelines explicitly prohibit such applications.
Pricing:
freemium - NExT-GPT is open-source under BSD-3-Clause license, indicating a free but restricted-for-commercial-use model without associated direct monetary cost.
Requirements:
Min 8 GB RAM; - The repository notes that the code and models are intended for non-commercial use only and must not be used in any illegal or harmful contexts.; - Potential commercial users should seek approval from the authors, making it unsuitable without prior authorization if commercial application is considered.

Observed Jul 12, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Dormant (461d since push)
As of 4d
Provenance
Not a fork · Personal account
As of 4d
Security (OSV)
148 low (148 low)
As of 1mo

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install NExT-GPT
PyPI

How it fits your stack(8)

Typed graph edges - alternatives, integrations, successors, and dependencies. Ranked by relationship type, not raw GitHub stars.

Relationship graph

Optional deeper exploration of typed edges and category neighbours.

Similar tools

Same-category neighbours not already linked as typed edges.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

This repository contains the source code and models for NExT-GPT, a research project aimed at developing an Any-to-Any Multimodal Large Language Model. It includes implementations related to instruction-tuning, and visual-language-learning.

Capability facts

Languages
python

Source: github.language · Aug 18, 2026

Categories

Graph entities

Tags

README

Getting Started


License Notices

This repository is under BSD 3-Clause License. NExT-GPT is a research project intended for non-commercial use only. One must NOT use the code of NExT-GPT for any illegal, harmful, violent, racist, or sexual purposes. One is strictly prohibited from engaging in any activity that will potentially violate these guidelines. Any potential commercial use of this code should be approved by the authors.

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.