ML Research Wiki / Benchmarks / Text-to-Music Generation / MusicCaps

MusicCaps

Text-to-Music Generation Benchmark

Performance Over Time

📊 Showing 20 results | 📏 Metric: FAD

Top Performing Models

Rank Model Paper FAD Date Code
1 Riffusion MusicLM: Generating Music From Text 13.40 2023-01-26 📦 facebookresearch/audiocraft 📦 lucidrains/musiclm-pytorch 📦 zhvng/open-musiclm 📦 pwc-1/Paper-9 📦 MindSpore-scientific/code-8
2 Mubert MusicLM: Generating Music From Text 9.60 2023-01-26 📦 facebookresearch/audiocraft 📦 lucidrains/musiclm-pytorch 📦 zhvng/open-musiclm 📦 pwc-1/Paper-9 📦 MindSpore-scientific/code-8
3 MeLoDy Efficient Neural Music Generation 5.41 2023-05-25 -
4 MusicGen w/ random melody (1.5B) Simple and Controllable Music Generation 5.00 2023-06-08 📦 facebookresearch/audiocraft 📦 whisperspeech/whisperspeech 📦 collabora/whisperspeech
5 MusicLM MusicLM: Generating Music From Text 4.00 2023-01-26 📦 facebookresearch/audiocraft 📦 lucidrains/musiclm-pytorch 📦 zhvng/open-musiclm 📦 pwc-1/Paper-9 📦 MindSpore-scientific/code-8
6 Noise2Music spectrogram Noise2Music: Text-conditioned Music Generation with Diffusion Models 3.84 2023-02-08 -
7 MusicGen w/o melody (3.3B) Simple and Controllable Music Generation 3.80 2023-06-08 📦 facebookresearch/audiocraft 📦 whisperspeech/whisperspeech 📦 collabora/whisperspeech
8 Stable Audio Open Stable Audio Open 3.51 2024-07-19 📦 stability-ai/stable-audio-tools
9 MusicGen w/o melody (1.5B) Simple and Controllable Music Generation 3.40 2023-06-08 📦 facebookresearch/audiocraft 📦 whisperspeech/whisperspeech 📦 collabora/whisperspeech
10 AudioLDM 2-Full AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretraining 3.13 2023-08-10 📦 haoheliu/AudioLDM2 📦 haoheliu/audioldm-training-finetuning

All Papers (20)