ML Research Wiki / Benchmarks / Visual Question Answering (VQA) / VQA-CP

VQA-CP

Visual Question Answering (VQA) Benchmark

Performance Over Time

📊 Showing 10 results | 📏 Metric: Score

Top Performing Models

Rank	Model	Paper	Score	Date	Code
1	CSS 📚	Counterfactual Samples Synthesizing for Robust Visual Question Answering	58.95	2020-03-14	📦 yanxinzju/CSS-VQA 📦 FengSuSky/CCB-VQA
2	GGE-DQ	Greedy Gradient Ensemble for Robust Visual Question Answering	57.32	2021-07-27	📦 GeraldHan/GGE
3	LMH+Entropy regularization (Ensemble)	Removing Bias in Multi-modal Classifiers: Regularization by Maximizing Functional Entropies	56.74	2020-10-21	📦 itaigat/removing-bias-in-multi-modal-classifiers
4	LMH+Entropy regularization	Removing Bias in Multi-modal Classifiers: Regularization by Maximizing Functional Entropies	54.55	2020-10-21	📦 itaigat/removing-bias-in-multi-modal-classifiers
5	Learned-Mixin +H	Don't Take the Easy Way Out: Ensemble Based Methods for Avoiding Known Dataset Biases	52.05	2019-09-09	📦 chrisc36/debias 📦 itaigat/removing-bias-in-multi-modal-classifiers 📦 chrisc36/bottom-up-attention-vqa
6	UpDn+SCR (VQA-X)	Self-Critical Reasoning for Robust Visual Question Answering	49.45	2019-05-24	📦 jialinwu17/Self_Critical_VQA
7	RUBi	RUBi: Reducing Unimodal Biases in Visual Question Answering	47.11	2019-06-24	📦 cdancette/rubi.bootstrap.pytorch
8	NSM	Learning by Abstraction: The Neural State Machine	45.80	2019-07-09	📦 stanfordnlp/mac-network 📦 ceyzaguirre4/NSM 📦 abwilf/social-iq-2.0-challenge 📦 gchaperon/neural-state-machine
9	MuRel	MUREL: Multimodal Relational Reasoning for Visual Question Answering	39.54	2019-02-25	📦 Cadene/murel.bootstrap.pytorch
10	HAN	Learning Visual Question Answering by Bootstrapping Hard Attention	28.65	2018-08-01	📦 lienchibao1998/new

All Papers (10)

Counterfactual Samples Synthesizing for Robust Visual Question Answering

2020

CSS

yanxinzju/CSS-VQA FengSuSky/CCB-VQA

Greedy Gradient Ensemble for Robust Visual Question Answering

2021

GGE-DQ

GeraldHan/GGE

Removing Bias in Multi-modal Classifiers: Regularization by Maximizing Functional Entropies

2020

LMH+Entropy regularization (Ensemble)

itaigat/removing-bias-in-multi-modal-classifiers

Removing Bias in Multi-modal Classifiers: Regularization by Maximizing Functional Entropies

2020

LMH+Entropy regularization

itaigat/removing-bias-in-multi-modal-classifiers

Don't Take the Easy Way Out: Ensemble Based Methods for Avoiding Known Dataset Biases

2019

Learned-Mixin +H

chrisc36/debias itaigat/removing-bias-in-multi-modal-classifiers chrisc36/bottom-up-attention-vqa

Self-Critical Reasoning for Robust Visual Question Answering

2019

UpDn+SCR (VQA-X)

jialinwu17/Self_Critical_VQA

RUBi: Reducing Unimodal Biases in Visual Question Answering

2019

RUBi

cdancette/rubi.bootstrap.pytorch

Learning by Abstraction: The Neural State Machine

2019

NSM

stanfordnlp/mac-network ceyzaguirre4/NSM

MUREL: Multimodal Relational Reasoning for Visual Question Answering

2019

MuRel

Cadene/murel.bootstrap.pytorch

Learning Visual Question Answering by Bootstrapping Hard Attention

2018

HAN

lienchibao1998/new

VQA-CP

Performance Over Time

Edit Benchmark Results

Edit Result

Top Performing Models

All Papers (10)

Counterfactual Samples Synthesizing for Robust Visual Question Answering

Greedy Gradient Ensemble for Robust Visual Question Answering

Removing Bias in Multi-modal Classifiers: Regularization by Maximizing Functional Entropies

Removing Bias in Multi-modal Classifiers: Regularization by Maximizing Functional Entropies

Don't Take the Easy Way Out: Ensemble Based Methods for Avoiding Known Dataset Biases

Self-Critical Reasoning for Robust Visual Question Answering

RUBi: Reducing Unimodal Biases in Visual Question Answering

Learning by Abstraction: The Neural State Machine

MUREL: Multimodal Relational Reasoning for Visual Question Answering

Learning Visual Question Answering by Bootstrapping Hard Attention

Model	Paper	Score	Date
CSS	Counterfactual Samples Synthesizing for Robust Vi…	58.95	2020-03-14
GGE-DQ	Greedy Gradient Ensemble for Robust Visual Questi…	57.32	2021-07-27
LMH+Entropy regularization (Ensemble)	Removing Bias in Multi-modal Classifiers: Regular…	56.74	2020-10-21
LMH+Entropy regularization	Removing Bias in Multi-modal Classifiers: Regular…	54.55	2020-10-21
Learned-Mixin +H	Don't Take the Easy Way Out: Ensemble Based Metho…	52.05	2019-09-09
UpDn+SCR (VQA-X)	Self-Critical Reasoning for Robust Visual Questio…	49.45	2019-05-24
RUBi	RUBi: Reducing Unimodal Biases in Visual Question…	47.11	2019-06-24
NSM	Learning by Abstraction: The Neural State Machine	45.80	2019-07-09
MuRel	MUREL: Multimodal Relational Reasoning for Visual…	39.54	2019-02-25
HAN	Learning Visual Question Answering by Bootstrappi…	28.65	2018-08-01