VAR

FoundationVision/VAR

[NeurIPS 2024 Best Paper Award][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeli

8.7k
Stars
569
Forks
60
Open issues
100
Watchers
Jupyter Notebook MITLast pushed Nov 10, 2025

[NeurIPS 2024 Best Paper Award][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

Categories

Tags

Similar tools

Install

git clone https://github.com/FoundationVision/VAR

README

VAR: a new visual generation method elevates GPT-style models beyond diffusion🚀 & Scaling laws observed📈

     

Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction

NeurIPS 2024 Best Paper


News

  • 2025-11: We Release our Text-to-Video generation model InfinityStar based on VAR & Infinity, please check Infinity⭐️.
  • 2025-11: 🎉 InfinityStar is accepted as NeurIPS 2025 Oral.
  • 2025-04: 🎉 Infinity is accepted as CVPR 2025 Oral.
  • 2024-12: 🏆 VAR received NeurIPS 2024 Best Paper Award.
  • 2024-12: 🔥 We Release our Text-to-Image research based on VAR, please check Infinity.
  • 2024-09: VAR is accepted as NeurIPS 2024 Oral Presentation.
  • 2024-04: Visual AutoRegressive modeling is released.

🕹️ Try and Play with VAR!

We provide a demo website for you to play with VAR models and generate images interactively. Enjoy the fun of visual autoregressive modeling!

We provide a demo website for you to play with VAR Text-to-Image and generate images interactively. Enjoy the fun of visual autoregressive modeling!

We also provide demo_sample.ipynb for you to see more technical details about VAR.

What's New?

🔥 Introducing VAR: a new paradigm in autoregressive visual generation✨:

Visual Autoregressive Modeling (VAR) redefines the autoregressive learning on images as coarse-to-fine "next-scale prediction" or "next-resolution prediction", diverging from the standard raster-scan "next-token prediction".

🔥 For the first time, GPT-style autoregressive models surpass diffusion models🚀:

🔥 Discovering power-law Scaling Laws in VAR transformers📈:

🔥 Zero-shot generalizability🛠️:

For a deep dive into our analyses, discussions, and evaluations, check out our paper.

VAR zoo

We provide VAR models for you to play with, which are on or can be downloaded from the following links:

modelreso.FIDrel. cost#paramsHF weights🤗
VAR-d162563.550.4310M[var_d16.pth](https://huggingface.co/FoundationVision/va