ML Research Wiki / Benchmarks / Text to Audio Retrieval / AudioCaps

AudioCaps

Text to Audio Retrieval Benchmark

Performance Over Time

📊 Showing 11 results | 📏 Metric: R@1

Top Performing Models

Rank Model Paper R@1 Date Code
1 InternVideo2-6B 📚 InternVideo2: Scaling Foundation Models for Multimodal Video Understanding 55.20 2024-03-22 📦 opengvlab/internvideo 📦 opengvlab/internvideo2
2 VAST 📚 VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset 52.00 2023-05-29 📦 TXH-mercury/VALOR 📦 txh-mercury/vast
3 ONE-PEACE 📚 ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities 42.50 2023-05-18 📦 modelscope/modelscope 📦 OFA-Sys/ONE-PEACE
4 VALOR 📚 VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset 40.10 2023-04-17 📦 TXH-mercury/VALOR
5 AL-MixGen + Multi-TTA Exploring Train and Test-Time Augmentations for Audio-Language Learning 34.70 2022-10-31 -
6 QB-Norm+CE Cross Modal Retrieval with Querybank Normalisation 23.90 2021-12-23 📦 ioanacroi/qb-norm
7 MMT Audio Retrieval with Natural Language Queries: A Benchmark Study 0.00 2021-12-17 📦 akoepke/audio-retrieval-benchmark
8 CE Audio Retrieval with Natural Language Queries: A Benchmark Study 0.00 2021-12-17 📦 akoepke/audio-retrieval-benchmark
9 CE Audio Retrieval with Natural Language Queries 0.00 2021-05-05 📦 oncescuandreea/audio-retrieval
10 MoEE Audio Retrieval with Natural Language Queries: A Benchmark Study 0.00 2021-12-17 📦 akoepke/audio-retrieval-benchmark

All Papers (11)

opengvlab/internvideo opengvlab/internvideo2
TXH-mercury/VALOR txh-mercury/vast
modelscope/modelscope OFA-Sys/ONE-PEACE
TXH-mercury/VALOR
ioanacroi/qb-norm
akoepke/audio-retrieval-benchmark
akoepke/audio-retrieval-benchmark
oncescuandreea/audio-retrieval
akoepke/audio-retrieval-benchmark
oncescuandreea/audio-retrieval