The goal of ARQMath is to advance techniques for mathematical information retrieval, in particular, retrieving answers to mathematical questions (Task 1), and formula retrieval (Task 2).
Using the question posts from Math Stack Exchange, participating systems are given a question or a formula from a question and asked to return a ranked list of either potential answers to the question or potentially useful formulae (in the case of a formula query). Relevance is determined by the expected utility of each returned item. These tasks allow participating teams to explore leveraging math notation together with text to improve the quality of retrieval results.
Variants: ARQMath
This dataset is used in 1 benchmark:
Task | Model | Paper | Date |
---|---|---|---|
Math Information Retrieval | Approach0+ColBERT (reranking) | Evaluating Token-Level and Passage-Level Dense … | 2022-03-21 |
Math Information Retrieval | Approach0+ColBERT (fusion) | Evaluating Token-Level and Passage-Level Dense … | 2022-03-21 |
Recent papers with results on this dataset: