ML Research Wiki / Benchmarks / Automatic Speech Recognition (ASR) / LRS2

LRS2

Automatic Speech Recognition (ASR) Benchmark

Performance Over Time

📊 Showing 9 results | 📏 Metric: Test WER

Top Performing Models

Rank Model Paper Test WER Date Code
1 TM-CTC Deep Audio-Visual Speech Recognition 10.10 2018-09-06 📦 lordmartian/deep_avsr 📦 smeetrs/deep_avsr 📦 exgc/avmust-ted 📦 amitai1992/AutomatedLipReading
2 TM-seq2seq Deep Audio-Visual Speech Recognition 9.70 2018-09-06 📦 lordmartian/deep_avsr 📦 smeetrs/deep_avsr 📦 exgc/avmust-ted 📦 amitai1992/AutomatedLipReading
3 CTC/attention Audio-Visual Speech Recognition With A Hybrid CTC/Attention Architecture 8.20 2018-09-28 -
4 LF-MMI TDNN Audio-visual Recognition of Overlapped speech for the LRS2 dataset 6.70 2020-01-06 -
5 Whisper-LLaMA Whispering LLaMA: A Cross-Modal Generative Error Correction Framework for Speech Recognition 6.60 2023-10-10 📦 srijith-rkr/whispering-llama
6 End2end Conformer End-to-end Audio-visual Speech Recognition with Conformers 3.90 2021-02-12 📦 zziz/pwc 📦 mpc001/Visual_Speech_Recognition_for_Multiple_Languages 📦 mpc001/auto_avsr
7 MoCo + wav2vec (w/o extLM) Leveraging Unimodal Self-Supervised Learning for Multimodal Audio-Visual Speech Recognition 2.70 2022-02-24 📦 lumia-group/leveraging-self-supervised-learning-for-avsr
8 CTC/Attention 📚 Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labels 1.50 2023-03-25 📦 mpc001/auto_avsr 📦 umbertocappellazzo/llama-avsr
9 Whisper 📚 Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation 1.30 2024-06-14 📦 roudimit/whisper-flamingo

All Papers (9)

lordmartian/deep_avsr smeetrs/deep_avsr
lordmartian/deep_avsr smeetrs/deep_avsr
srijith-rkr/whispering-llama
zziz/pwc mpc001/Visual_Speech_Recognition_for_Multiple_Languages mpc001/auto_avsr
lumia-group/leveraging-self-supervised-learning-for-avsr
mpc001/auto_avsr umbertocappellazzo/llama-avsr
roudimit/whisper-flamingo