ML Research Wiki / Benchmarks / Visual Reasoning / VSR

VSR

Visual Reasoning Benchmark

Performance Over Time

📊 Showing 5 results | 📏 Metric: accuracy

Click "Edit" next to any result to modify it, or add a new result at the bottom. All changes will be reviewed before going live.

Yellow rows = Pending edits Green rows = Pending new results

Model	Paper	accuracy	Date
LXMERT	Visual Spatial Reasoning	70.10	2022-04-30
ViLT	Visual Spatial Reasoning	69.30	2022-04-30
CLIP (finetuned)	Visual Spatial Reasoning	65.10	2022-04-30
CLIP (frozen)	Visual Spatial Reasoning	56.00	2022-04-30
VisualBERT	Visual Spatial Reasoning	55.20	2022-04-30

Rank	Model	Paper	accuracy	Date	Code
1	LXMERT	Visual Spatial Reasoning	70.10	2022-04-30	📦 cambridgeltl/visual-spatial-reasoning 📦 ziyan-xiaoyu/spatialmqa 📦 sohojoe/clip_visual-spatial-reasoning 📦 MindCode-4/code-1
2	ViLT	Visual Spatial Reasoning	69.30	2022-04-30	📦 cambridgeltl/visual-spatial-reasoning 📦 ziyan-xiaoyu/spatialmqa 📦 sohojoe/clip_visual-spatial-reasoning 📦 MindCode-4/code-1
3	CLIP (finetuned)	Visual Spatial Reasoning	65.10	2022-04-30	📦 cambridgeltl/visual-spatial-reasoning 📦 ziyan-xiaoyu/spatialmqa 📦 sohojoe/clip_visual-spatial-reasoning 📦 MindCode-4/code-1
4	CLIP (frozen)	Visual Spatial Reasoning	56.00	2022-04-30	📦 cambridgeltl/visual-spatial-reasoning 📦 ziyan-xiaoyu/spatialmqa 📦 sohojoe/clip_visual-spatial-reasoning 📦 MindCode-4/code-1
5	VisualBERT	Visual Spatial Reasoning	55.20	2022-04-30	📦 cambridgeltl/visual-spatial-reasoning 📦 ziyan-xiaoyu/spatialmqa 📦 sohojoe/clip_visual-spatial-reasoning 📦 MindCode-4/code-1