ML Research Wiki / Benchmarks / Question Answering / TrecQA

TrecQA

Question Answering Benchmark

Performance Over Time

📊 Showing 12 results | 📏 Metric: MAP

Top Performing Models

Rank	Model	Paper	MAP	Date	Code
1	TANDA DeBERTa-V3-Large + ALL 📚	Structural Self-Supervised Objectives for Transformers	0.95	2023-09-15	📦 lucadiliello/transformers-framework
2	TANDA-RoBERTa (ASNQ, TREC-QA) 📚	TANDA: Transfer and Adapt Pre-Trained Transformer Models for Answer Sentence Selection	0.94	2019-11-11	📦 alexa/wqa_tanda 📦 samrelins/tanda_search_qa_tool
3	DeBERTa-V3-Large + SSP	Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection	0.92	2022-05-20	-
4	Contextual DeBERTa-V3-Large + SSP 📚	Context-Aware Transformer Pre-Training for Answer Sentence Selection	0.92	2023-05-24	-
5	RLAS-BIABC	RLAS-BIABC: A Reinforcement Learning-Based Answer Selection Using the BERT Model Boosted by an Improved ABC Algorithm	0.91	2023-01-07	-
6	RoBERTa-Base Joint + MSPP	Paragraph-based Transformer Pre-training for Multi-Sentence Inference	0.91	2022-05-02	📦 amazon-research/wqa-multi-sentence-inference
7	RoBERTa-Base + PSD	Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection	0.90	2022-05-20	-
8	Comp-Clip + LM + LC	A Compare-Aggregate Model with Latent Clustering for Answer Selection	0.87	2019-05-30	-
9	NLP-Capsule	Towards Scalable and Reliable Capsule Networks for Challenging NLP Applications	0.78	2019-06-06	📦 andyweizhao/capsule_text_classification 📦 andyweizhao/capsule 📦 andyweizhao/NLP-Capsule 📦 AIPHES/acl19-generalization-capsule 📦 kevindeangeli/capsuleNetwork
10	HyperQA	Hyperbolic Representation Learning for Fast and Efficient Neural Question Answering	0.77	2017-07-25	📦 vanzytay/WSDM2018_HyperQA

All Papers (12)

Structural Self-Supervised Objectives for Transformers

2023

TANDA DeBERTa-V3-Large + ALL

lucadiliello/transformers-framework

TANDA: Transfer and Adapt Pre-Trained Transformer Models for Answer Sentence Selection

2019

TANDA-RoBERTa (ASNQ, TREC-QA)

alexa/wqa_tanda samrelins/tanda_search_qa_tool

Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection

2022

DeBERTa-V3-Large + SSP

Context-Aware Transformer Pre-Training for Answer Sentence Selection

2023

Contextual DeBERTa-V3-Large + SSP

RLAS-BIABC: A Reinforcement Learning-Based Answer Selection Using the BERT Model Boosted by an Improved ABC Algorithm

2023

RLAS-BIABC

Paragraph-based Transformer Pre-training for Multi-Sentence Inference

2022

RoBERTa-Base Joint + MSPP

amazon-research/wqa-multi-sentence-inference

Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection

2022

RoBERTa-Base + PSD

A Compare-Aggregate Model with Latent Clustering for Answer Selection

2019

Comp-Clip + LM + LC

Towards Scalable and Reliable Capsule Networks for Challenging NLP Applications

2019

NLP-Capsule

andyweizhao/capsule_text_classification andyweizhao/capsule

Hyperbolic Representation Learning for Fast and Efficient Neural Question Answering

2017

HyperQA

vanzytay/WSDM2018_HyperQA

aNMM: Ranking Short Answer Texts with Attention-Based Neural Matching Model

2018

aNMM

yangliuy/aNMM-CIKM16

Deep Learning for Answer Sentence Selection

2014

CNN

brmson/dataset-sts umutguneri/Question-Answering-Assistant

TrecQA

Performance Over Time

Edit Benchmark Results

Edit Result

Top Performing Models

All Papers (12)

Structural Self-Supervised Objectives for Transformers

TANDA: Transfer and Adapt Pre-Trained Transformer Models for Answer Sentence Selection

Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection

Context-Aware Transformer Pre-Training for Answer Sentence Selection

RLAS-BIABC: A Reinforcement Learning-Based Answer Selection Using the BERT Model Boosted by an Improved ABC Algorithm

Paragraph-based Transformer Pre-training for Multi-Sentence Inference

Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection

A Compare-Aggregate Model with Latent Clustering for Answer Selection

Towards Scalable and Reliable Capsule Networks for Challenging NLP Applications

Hyperbolic Representation Learning for Fast and Efficient Neural Question Answering

aNMM: Ranking Short Answer Texts with Attention-Based Neural Matching Model

Deep Learning for Answer Sentence Selection

Model	Paper	MAP	Date
TANDA DeBERTa-V3-Large + ALL	Structural Self-Supervised Objectives for Transfo…	0.95	2023-09-15
TANDA-RoBERTa (ASNQ, TREC-QA)	TANDA: Transfer and Adapt Pre-Trained Transformer…	0.94	2019-11-11
DeBERTa-V3-Large + SSP	Pre-training Transformer Models with Sentence-Lev…	0.92	2022-05-20
Contextual DeBERTa-V3-Large + SSP	Context-Aware Transformer Pre-Training for Answer…	0.92	2023-05-24
RLAS-BIABC	RLAS-BIABC: A Reinforcement Learning-Based Answer…	0.91	2023-01-07
RoBERTa-Base Joint + MSPP	Paragraph-based Transformer Pre-training for Mult…	0.91	2022-05-02
RoBERTa-Base + PSD	Pre-training Transformer Models with Sentence-Lev…	0.90	2022-05-20
Comp-Clip + LM + LC	A Compare-Aggregate Model with Latent Clustering …	0.87	2019-05-30
NLP-Capsule	Towards Scalable and Reliable Capsule Networks fo…	0.78	2019-06-06
HyperQA	Hyperbolic Representation Learning for Fast and E…	0.77	2017-07-25
aNMM	aNMM: Ranking Short Answer Texts with Attention-B…	0.75	2018-01-05
CNN	Deep Learning for Answer Sentence Selection	0.71	2014-12-04