WebQuestions

Dataset Information
Modalities
Texts
Languages
English
Introduced
2013
License
Unknown
Homepage

Overview

The WebQuestions dataset is a question answering dataset using Freebase as the knowledge base and contains 6,642 question-answer pairs. It was created by crawling questions through the Google Suggest API, and then obtaining answers using Amazon Mechanical Turk. The original split uses 3,778 examples for training and 2,032 for testing. All answers are defined as Freebase entities.

Example questions (answers) in the dataset include “Where did Edgar Allan Poe died?” (baltimore) or “What degrees did Barack Obama get?” (bachelor_of_arts, juris_doctor).

Source: Question Answering with Subgraph Embeddings
Image Source: Berant et al

Variants: WebQuestions

Associated Benchmarks

This dataset is used in 3 benchmarks:

Recent Benchmark Submissions

Task Model Paper Date
Question Answering CoA Chain-of-Action: Faithful and Multimodal Question … 2024-03-26
Question Answering Few-shot Chain-of-Action: Faithful and Multimodal Question … 2024-03-26
Question Answering DSP Chain-of-Action: Faithful and Multimodal Question … 2024-03-26
Question Answering Zero-shot Chain-of-Action: Faithful and Multimodal Question … 2024-03-26
Question Answering Self-Ask Chain-of-Action: Faithful and Multimodal Question … 2024-03-26
Question Answering CoT Chain-of-Action: Faithful and Multimodal Question … 2024-03-26
Question Answering React Chain-of-Action: Faithful and Multimodal Question … 2024-03-26
Question Answering CoA w/o actions Chain-of-Action: Faithful and Multimodal Question … 2024-03-26
Question Answering ToT Chain-of-Action: Faithful and Multimodal Question … 2024-03-26
Question Answering DSP DSPy: Compiling Declarative Language Model … 2023-10-05
Question Answering PaLM 2-S (one-shot) PaLM 2 Technical Report 2023-05-17
Question Answering ToT Tree of Thoughts: Deliberate Problem … 2023-05-17
Question Answering PaLM 2-L (one-shot) PaLM 2 Technical Report 2023-05-17
Question Answering PaLM 2-M (one-shot) PaLM 2 Technical Report 2023-05-17
Question Answering FiDO FiDO: Fusion-in-Decoder optimized for stronger … 2022-12-15
Question Answering FiE+PAQ FiE: Building a Global Probability … 2022-11-18
Open-Domain Question Answering FiE FiE: Building a Global Probability … 2022-11-18
Question Answering FiE FiE: Building a Global Probability … 2022-11-18
Open-Domain Question Answering FiE+PAQ FiE: Building a Global Probability … 2022-11-18
Question Answering Self-Ask Measuring and Narrowing the Compositionality … 2022-10-07

Research Papers

Recent papers with results on this dataset: