MATH

Overview edit

Variants: MATH, MATH minival

Associated Benchmarks

This dataset is used in 1 benchmark:

• Math Word Problem Solving - Metrics: Accuracy, Parameters (Billions)

Recent Benchmark Submissions

Research Papers

Recent papers with results on this dataset:

• OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction Data (2024) -
• Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvement (2024) -
• Qwen2 Technical Report (2024) -
• Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs (2024) -
• DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving (2024) -
• AlphaMath Almost Zero: Process Supervision without Process (2024) -
• Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing (2024) -
• MACM: Utilizing a Multi-Agent System for Condition Mining in Solving Complex Mathematical Problems (2024) -
• Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM (2024) -
• Key-Point-Driven Data Synthesis with its Enhancement on Mathematical Reasoning (2024) -
• An Empirical Study of Data Ability Boundary in LLMs' Math Reasoning (2024) -
• OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset (2024) -
• DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models (2024) -
• Augmenting Math Word Problems via Iterative Question Composing (2024) -
• Mixtral of Experts (2024) -
• Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General Tasks (2024) -
• Gemini: A Family of Highly Capable Multimodal Models (2023) -
• Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations (2023) -
• Mistral 7B (2023) -
• MuggleMath: Assessing the Impact of Query and Response Augmentation on Math Reasoning (2023) -