MapEval-API

Dataset Information
Modalities
Texts
Languages
English
Introduced
2024
Homepage

Overview

MapEval-Textual contains 300 question-answer pairs. The task is to answer question by fetching necessary informations using external Map APIs.

Variants: MapEval-API

Associated Benchmarks

This dataset is used in 1 benchmark:

Recent Benchmark Submissions

Task Model Paper Date
Question Answering Claude-3.5-Sonnet (ReAct) MapEval: A Map-Based Evaluation of … 2024-12-31
Question Answering GPT-3.5-Turbo (Chameleon) MapEval: A Map-Based Evaluation of … 2024-12-31

Research Papers

Recent papers with results on this dataset: