ML Research Wiki / Benchmarks / Question Answering / Quora Question Pairs

Quora Question Pairs

Question Answering Benchmark

Performance Over Time

📊 Showing 19 results | 📏 Metric: Accuracy

Top Performing Models

Rank Model Paper Accuracy Date Code
1 24hBERT How to Train BERT with an Academic Budget 70.70 2021-04-15 📦 peteriz/academic-budget-bert 📦 IntelLabs/academic-budget-bert 📦 octanove/shiba 📦 yxzwang/normalized-information-payload
2 XLNet (single model) XLNet: Generalized Autoregressive Pretraining for Language Understanding 0.00 2019-06-19 📦 huggingface/transformers 📦 PaddlePaddle/PaddleNLP 📦 zihangdai/xlnet
3 DeBERTa (large) DeBERTa: Decoding-enhanced BERT with Disentangled Attention 0.00 2020-06-05 📦 huggingface/transformers 📦 microsoft/DeBERTa 📦 osu-nlp-group/mind2web
4 ALBERT ALBERT: A Lite BERT for Self-supervised Learning of Language Representations 0.00 2019-09-26 📦 huggingface/transformers 📦 tensorflow/models 📦 PaddlePaddle/PaddleNLP
5 T5-11B Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer 0.00 2019-10-23 📦 huggingface/transformers 📦 PaddlePaddle/PaddleNLP 📦 google-research/text-to-text-transfer-transformer
6 MLM+ subs+ del-span CLEAR: Contrastive Learning for Sentence Representation 0.00 2020-12-31 -
7 RoBERTa (ensemble) RoBERTa: A Robustly Optimized BERT Pretraining Approach 0.00 2019-07-26 📦 huggingface/transformers 📦 pytorch/fairseq 📦 PaddlePaddle/PaddleNLP
8 ERNIE 2.0 Large ERNIE 2.0: A Continual Pre-training Framework for Language Understanding 0.00 2019-07-29 📦 PaddlePaddle/PaddleNLP 📦 PaddlePaddle/ERNIE 📦 DataScienceNigeria/ERNIE-2.0-from-Baidu-Inc.
9 ELECTRA ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators 0.00 2020-03-23 📦 huggingface/transformers 📦 tensorflow/models 📦 PaddlePaddle/PaddleNLP
10 T5-Large 770M Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer 0.00 2019-10-23 📦 huggingface/transformers 📦 PaddlePaddle/PaddleNLP 📦 google-research/text-to-text-transfer-transformer

All Papers (19)