StrategyQA

Dataset Information
Modalities
Texts
Languages
English
Introduced
2021
License
Unknown
Homepage
Official Website
Contents

Overview

StrategyQA is a question answering benchmark where the required reasoning steps are implicit in the question, and should be inferred using a strategy.
It includes 2,780 examples, each consisting of a strategy question, its decomposition, and evidence paragraphs.
Questions in StrategyQA are short, topic-diverse, and cover a wide range of strategies.

Variants: StrategyQA

Associated Benchmarks

This dataset is used in 1 benchmark:

Recent Benchmark Submissions

Task Model Paper Date
Question Answering Least-to-Most Chain-of-Action: Faithful and Multimodal Question … 2024-03-26
Question Answering CoA Chain-of-Action: Faithful and Multimodal Question … 2024-03-26
Question Answering SearchChain Chain-of-Action: Faithful and Multimodal Question … 2024-03-26
Question Answering CoA w/o actions Chain-of-Action: Faithful and Multimodal Question … 2024-03-26
Question Answering PaLM 2 (few-shot, CoT, SC) PaLM 2 Technical Report 2023-05-17
Question Answering SearchChain Search-in-the-Chain: Interactively Enhancing Large Language … 2023-04-28
Question Answering Rethinking with retrieval (GPT-3) Rethinking with Retrieval: Faithful Large … 2022-12-31
Question Answering PaLM 540B Transcending Scaling Laws with 0.1% … 2022-10-20
Question Answering Minerva 540B Transcending Scaling Laws with 0.1% … 2022-10-20
Question Answering U-PaLM 540B Transcending Scaling Laws with 0.1% … 2022-10-20
Question Answering Least-to-Most Least-to-Most Prompting Enables Complex Reasoning … 2022-05-21

Research Papers

Recent papers with results on this dataset:

External Links: