ML Research Wiki / Benchmarks / Visual Question Answering (VQA) / VQA-CE

VQA-CE

Visual Question Answering (VQA) Benchmark

Performance Over Time

📊 Showing 9 results | 📏 Metric: Accuracy (Counterexamples)

Top Performing Models

Rank Model Paper Accuracy (Counterexamples) Date Code
1 RandImg Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering 34.41 2021-04-07 📦 cdancette/detect-shortcuts
2 LMH + CSS Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering 34.36 2021-04-07 📦 cdancette/detect-shortcuts
3 LFF Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering 34.27 2021-04-07 📦 cdancette/detect-shortcuts
4 LMH Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering 34.26 2021-04-07 📦 cdancette/detect-shortcuts
5 UpDown Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering 33.91 2021-04-07 📦 cdancette/detect-shortcuts
6 ESR Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering 33.26 2021-04-07 📦 cdancette/detect-shortcuts
7 LMH + RMFE Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering 33.14 2021-04-07 📦 cdancette/detect-shortcuts
8 BLOCK Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering 32.91 2021-04-07 📦 cdancette/detect-shortcuts
9 RUBi Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering 32.25 2021-04-07 📦 cdancette/detect-shortcuts

All Papers (9)

cdancette/detect-shortcuts
cdancette/detect-shortcuts
cdancette/detect-shortcuts
cdancette/detect-shortcuts
cdancette/detect-shortcuts
cdancette/detect-shortcuts
cdancette/detect-shortcuts
cdancette/detect-shortcuts
cdancette/detect-shortcuts