{"data":{"slug":"moonintheriver-diffsinger","name":"DiffSinger","tagline":"DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism (SVS & TTS); AAAI 2022; Official code","github_url":"https://github.com/MoonInTheRiver/DiffSinger","owner":"MoonInTheRiver","repo":"DiffSinger","owner_avatar_url":"https://avatars.githubusercontent.com/u/32165188?v=4","primary_language":"Python","stars":4820,"forks":823,"topics":["aaai2022","diffusion-model","diffusion-speedup","midi","singing-synthesis","singing-voice","singing-voice-database","singing-voice-synthesis","speech-synthesis","text-to-speech","tts"],"archived":false,"github_pushed_at":"2025-03-19T06:51:33+00:00","maintenance_label":"Dormant","url":"https://www.graphcanon.com/tools/moonintheriver-diffsinger","markdown_url":"https://www.graphcanon.com/tools/moonintheriver-diffsinger.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/moonintheriver-diffsinger","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=moonintheriver-diffsinger","description":"DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism (SVS & TTS); AAAI 2022; Official code","homepage_url":null,"license":"MIT","open_issues":53,"watchers":43,"ai_summary":null,"readme_excerpt":"# DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism\n\n\n\n \n\n\n\nThis repository is the official PyTorch implementation of our AAAI-2022 [paper](https://arxiv.org/abs/2105.02446), in which we propose DiffSinger (for Singing-Voice-Synthesis) and DiffSpeech (for Text-to-Speech).\n \n\n:tada: :tada: :tada: **Updates**:\n - Sep.11, 2022: :electric_plug: [DiffSinger-PN](docs/README-SVS-opencpop-pndm.md). Add plug-in [PNDM](https://arxiv.org/abs/2202.09778), ICLR 2022 in our laboratory, to accelerate DiffSinger freely.\n - Jul.27, 2022: Update documents for [SVS](docs/README-SVS.md). Add easy inference [A](docs/README-SVS-opencpop-cascade.md#4-inference-from-raw-inputs) & [B](docs/README-SVS-opencpop-e2e.md#4-inference-from-raw-inputs); Add Interactive SVS running on [HuggingFace🤗 SVS](https://huggingface.co/spaces/Silentlin/DiffSinger).\n - Mar.2, 2022: MIDI-B-version.\n - Mar.1, 2022: [NeuralSVB](https://github.com/MoonInTheRiver/NeuralSVB), for singing voice beautifying, has been released.\n - Feb.13, 2022: [NATSpeech](https://github.com/NATSpeech/NATSpeech), the improved code framework, which contains the implementations of DiffSpeech and our NeurIPS-2021 work [PortaSpeech](https://openreview.net/forum?id=xmJsuh8xlq) has been released. \n - Jan.29, 2022: support MIDI-A-version SVS.\n - Jan.13, 2022: support SVS, release PopCS dataset.\n - Dec.19, 2021: support TTS. [HuggingFace🤗 TTS](https://huggingface.co/spaces/NATSpeech/DiffSpeech)\n \n:rocket: **News**: \n - Feb.24, 2022: Our new work, NeuralSVB was accepted by ACL-2022 . [Demo Page](https://neuralsvb.github.io).\n - Dec.01, 2021: DiffSinger was accepted by AAAI-2022.\n - Sep.29, 2021: Our recent work `PortaSpeech: Portable and High-Quality Generative Text-to-Speech` was accepted by NeurIPS-2021  .\n - May.06, 2021: We submitted DiffSinger to Arxiv .\n\n## Environments\n1. If you want to use env of anaconda:\n    ```sh\n    conda create -n your_env_name python=3.8\n    source activate your_env_name \n    pip install -r requirements_2080.txt   (GPU 2080Ti, CUDA 10.2)\n    or pip install -r requirements_3090.txt   (GPU 3090, CUDA 11.4)\n    ```\n\n2. Or, if you want to use virtual env of python:\n    ```sh\n    ## Install Python 3.8 first. \n    python -m venv venv\n    source venv/bin/activate\n    # install requirements.\n    pip install -U pip\n    pip install Cython numpy==1.19.1\n    pip install torch==1.9.0\n    pip install -r requirements.txt\n    ```\n\n## Documents\n- [Run DiffSpeech (TTS version)](docs/README-TTS.md).\n- [Run DiffSinger (SVS version)](docs/README-SVS.md).\n\n## Overview\n| Mel Pipeline                                                                                | Dataset                                                  | Pitch Input       | F0 Prediction |   Acceleration Method       | Vocoder                       |\n| ------------------------------------------------------------------------------------------- | ---------------------------------------------------------| ----------------- | ------------- | --------------------------- | ----------------------------- |\n| [DiffSpeech (Text->F0, Text+F0->Mel, Mel->Wav)](docs/README-TTS.md)                         | [Ljspeech](https://keithito.com/LJ-Speech-Dataset/)      | None              | Explicit      | Shallow Diffusion           | HiFiGAN                       |\n| [DiffSinger (Lyric+F0->Mel, Mel->Wav)](docs/README-SVS-popcs.md)                            | [PopCS](https://github.com/MoonInTheRiver/DiffSinger)    | Ground-Truth F0   | None          | Shallow Diffusion           | NSF-HiFiGAN                   |\n| [DiffSinger (Lyric+MIDI->F0, Lyric+F0->Mel, Mel->Wav)](docs/README-SVS-opencpop-cascade.md) | [OpenCpop](https://wenet.org.cn/opencpop/)               | MIDI              | Explicit      | Shallow Diffusion           | NSF-HiFiGAN                   |\n| [FFT-Singer (Lyric+MIDI->F0, Lyric+F0->Mel, Mel->Wav)](docs/README-SVS-opencpop-cascade.md) | [OpenCpop](https://wenet.org.cn/opencpop/)               | MIDI","github_created_at":"2021-12-17T04:38:03+00:00","created_at":"2026-07-11T12:06:47.088118+00:00","updated_at":"2026-07-11T12:06:59.794951+00:00","categories":[{"slug":"model-training","name":"Model Training","url":"https://www.graphcanon.com/categories/model-training","markdown_url":"https://www.graphcanon.com/categories/model-training.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/model-training"},{"slug":"speech-audio","name":"Speech & Audio","url":"https://www.graphcanon.com/categories/speech-audio","markdown_url":"https://www.graphcanon.com/categories/speech-audio.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/speech-audio"},{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"}],"tags":[{"slug":"singing-voice","name":"singing-voice"},{"slug":"midi","name":"midi"},{"slug":"singing-voice-database","name":"singing-voice-database"},{"slug":"singing-synthesis","name":"singing-synthesis"},{"slug":"aaai2022","name":"aaai2022"},{"slug":"diffusion-model","name":"diffusion-model"},{"slug":"diffusion-speedup","name":"diffusion-speedup"},{"slug":"singing-voice-synthesis","name":"singing-voice-synthesis"}],"trust":{"provenance":{"is_fork":false,"github_id":439211693,"owner_type":"User","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-07-11T12:06:47.683Z","maintenance":{"label":"Dormant","score":18,"methodology":"github_public_v1","releases_90d":0,"days_since_push":479,"last_release_at":"2022-01-17T03:30:08Z"},"security_summary":{"status":"findings","scanner":"osv@v1","low_count":24,"high_count":0,"last_scan_at":"2026-07-11T12:06:55.250Z","medium_count":0,"scan_profile":"deps","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-07-11T12:06:54.832Z"},"languages":{"value":["python"],"source":"github.language","observed_at":"2026-07-11T12:06:54.832Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-07-11T12:06:54.832Z"}}}}