ML Research Wiki / Benchmarks / Question Answering / StrategyQA

StrategyQA

Question Answering Benchmark

Performance Over Time

📊 Showing 11 results | 📏 Metric: Accuracy

Top Performing Models

Rank Model Paper Accuracy Date Code
1 PaLM 2 (few-shot, CoT, SC) PaLM 2 Technical Report 90.40 2023-05-17 📦 eternityyw/tram-benchmark
2 CoA Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models 79.20 2024-03-26 📦 MAGICS-LAB/Chain-of-Actions
3 Rethinking with retrieval (GPT-3) Rethinking with Retrieval: Faithful Large Language Model Inference 77.73 2022-12-31 📦 hornhehhf/rr
4 SearchChain Search-in-the-Chain: Interactively Enhancing Large Language Models with Search for Knowledge-intensive Tasks 77.00 2023-04-28 📦 xsc1234/search-in-the-chain
5 SearchChain Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models 77.00 2024-03-26 📦 MAGICS-LAB/Chain-of-Actions
6 U-PaLM 540B Transcending Scaling Laws with 0.1% Extra Compute 76.60 2022-10-20 -
7 PaLM 540B Transcending Scaling Laws with 0.1% Extra Compute 76.40 2022-10-20 -
8 CoA w/o actions Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models 70.60 2024-03-26 📦 MAGICS-LAB/Chain-of-Actions
9 Least-to-Most Least-to-Most Prompting Enables Complex Reasoning in Large Language Models 65.80 2022-05-21 📦 RUCAIBox/LLMBox
10 Least-to-Most Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models 65.80 2024-03-26 📦 MAGICS-LAB/Chain-of-Actions

All Papers (11)

PaLM 2 Technical Report

2023
PaLM 2 (few-shot, CoT, SC)
eternityyw/tram-benchmark
MAGICS-LAB/Chain-of-Actions
hornhehhf/rr
xsc1234/search-in-the-chain
MAGICS-LAB/Chain-of-Actions
MAGICS-LAB/Chain-of-Actions
RUCAIBox/LLMBox
MAGICS-LAB/Chain-of-Actions