ML Research Wiki / Benchmarks / Object Localization / IllusionVQA

IllusionVQA

Object Localization Benchmark

Performance Over Time

📊 Showing 9 results | 📏 Metric: Accuracy

Top Performing Models

Rank Model Paper Accuracy Date Code
1 GPT4-Vision 4-shot+CoT IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models 49.70 2024-03-23 📦 csebuetnlp/illusionvqa
2 GPT4-Vision 4-shot IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models 46.00 2024-03-23 📦 csebuetnlp/illusionvqa
3 Gemini-Pro IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models 43.50 2024-03-23 📦 csebuetnlp/illusionvqa
4 Gemini-Pro 4-shot IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models 41.80 2024-03-23 📦 csebuetnlp/illusionvqa
5 GPT4-Vision IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models 40.00 2024-03-23 📦 csebuetnlp/illusionvqa
6 Gemini-Pro 4-shot+CoT IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models 33.90 2024-03-23 📦 csebuetnlp/illusionvqa
7 CogVLM IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models 28.00 2024-03-23 📦 csebuetnlp/illusionvqa
8 LLaVA-1.5-13B IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models 24.80 2024-03-23 📦 csebuetnlp/illusionvqa
9 InstructBLIP-13B IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models 24.30 2024-03-23 📦 csebuetnlp/illusionvqa

All Papers (9)

csebuetnlp/illusionvqa
csebuetnlp/illusionvqa
csebuetnlp/illusionvqa
csebuetnlp/illusionvqa
csebuetnlp/illusionvqa
csebuetnlp/illusionvqa
csebuetnlp/illusionvqa
csebuetnlp/illusionvqa
csebuetnlp/illusionvqa