π Showing 2 results | π Metric: Accuracy (%)
Rank | Model | Paper | Accuracy (%) | Date | Code |
---|---|---|---|---|---|
1 | Claude-3.5-Sonnet (ReAct) | MapEval: A Map-Based Evaluation of Geo-Spatial Reasoning in Foundation Models | 64.00 | 2024-12-31 | π¦ MapEval/MapEval-Visual π¦ MapEval/MapEval-API π¦ MapEval/MapEval-Textual |
2 | GPT-3.5-Turbo (Chameleon) | MapEval: A Map-Based Evaluation of Geo-Spatial Reasoning in Foundation Models | 49.33 | 2024-12-31 | π¦ MapEval/MapEval-Visual π¦ MapEval/MapEval-API π¦ MapEval/MapEval-Textual |