SVAMP

Overview edit

Variants: SVAMP, SVAMP (1:N)

Associated Benchmarks

This dataset is used in 1 benchmark:

• Math Word Problem Solving - Metrics: Execution Accuracy, Accuracy

Recent Benchmark Submissions

Research Papers

Recent papers with results on this dataset:

• Teaching-Inspired Integrated Prompting Framework: A Novel Approach for Enhancing Reasoning in Large Language Models (2024) -
• Achieving >97% on GSM8K: Deeply Understanding the Problems Makes LLMs Better Solvers for Math Word Problems (2024) -
• An Empirical Study of Data Ability Boundary in LLMs' Math Reasoning (2024) -
• OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset (2024) -
• Frugal LMs Trained to Invoke Symbolic Solvers Achieve Parameter-Efficient Arithmetic Reasoning (2023) -
• ATHENA: Mathematical Reasoning with Thought Expansion (2023) -
• MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoning (2023) -
• Llama 2: Open Foundation and Fine-Tuned Chat Models (2023) -
• Math Word Problem Solving by Generating Linguistic Variants of Problem Statements (2023) -
• Learning Multi-Step Reasoning by Solving Arithmetic Tasks (2023) -
• Automatic Model Selection with Large Language Models for Reasoning (2023) -
• Progressive-Hint Prompting Improves Reasoning in Large Language Models (2023) -
• Large Language Models are Zero-Shot Reasoners (2022) -
• Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extraction (2022) -
• Are NLP Models really able to Solve Simple Math Word Problems? (2021) -