ML Research Wiki / Benchmarks / Open-Domain Question Answering / SearchQA

SearchQA

Open-Domain Question Answering Benchmark

Performance Over Time

📊 Showing 12 results | 📏 Metric: EM

Top Performing Models

Rank Model Paper EM Date Code
1 SpanBERT SpanBERT: Improving Pre-training by Representing and Predicting Spans 84.80 2019-07-24 📦 facebookresearch/SpanBERT 📦 mandarjoshi90/coref 📦 zixinzeng-jennifer/spanbert_trans
2 Cluster-Former (#C=512) Cluster-Former: Clustering-based Sparse Transformer for Long-Range Dependency Encoding 68.00 2020-09-13 -
3 Locality-Sensitive Hashing Reformer: The Efficient Transformer 66.00 2020-01-13 📦 huggingface/transformers 📦 google/trax 📦 lucidrains/reformer-pytorch
4 Multi-passage BERT Multi-passage BERT: A Globally Normalized BERT Model for Open-domain Question Answering 65.10 2019-08-22 -
5 Sparse Attention Generating Long Sequences with Sparse Transformers 64.70 2019-04-23 📦 mistralai/mistral-src 📦 openai/sparse_attention 📦 wilson1yan/VideoGPT
6 DecaProp Densely Connected Attention Propagation for Reading Comprehension 63.60 2018-11-10 📦 vanzytay/NIPS2018_DECAPROP 📦 ajenningsfrankston/NIPS2018_DECAPROP-master
7 DECAPROP Densely Connected Attention Propagation for Reading Comprehension 62.20 2018-11-10 📦 vanzytay/NIPS2018_DECAPROP 📦 ajenningsfrankston/NIPS2018_DECAPROP-master
8 AMANDA A Question-Focused Multi-Factor Attention Network for Question Answering 56.60 2018-01-25 📦 nusnlp/amanda
9 R^3 R$^3$: Reinforced Reader-Ranker for Open-Domain Question Answering 55.30 2017-08-31 📦 shuohangwang/mprc
10 Focused Hierarchical RNN Focused Hierarchical RNNs for Conditional Sequence Processing 53.40 2018-06-12 -

All Papers (12)