WiRe57

Dataset Information
Modalities
Texts
Languages
English
Introduced
2018
License
Unknown
Homepage
Official Website
Contents

Overview

We manually performed the task of Open Information Extraction on 5 short documents, elaborating tentative guidelines for the task, and resulting in a ground truth reference of 347 tuples. [section 1]

A small corpus of 57 sentences taken from the beginning of 5 documents in English was used as the source text from which to extract tuples. Three documents are Wikipedia articles (Chilly Gonzales, the EM algorithm, and Tokyo) and two are newswire articles (taken from Reuters, hence the Wi-Re name). [section 3.1]

Variants: WiRe57

Associated Benchmarks

This dataset is used in 1 benchmark:

Recent Benchmark Submissions

Task Model Paper Date
Open Information Extraction SenseOIE OpenIE6: Iterative Grid Labeling and … 2020-10-07
Open Information Extraction CIGL-OIE OpenIE6: Iterative Grid Labeling and … 2020-10-07
Open Information Extraction IMoJIE OpenIE6: Iterative Grid Labeling and … 2020-10-07
Open Information Extraction IGL-OIE OpenIE6: Iterative Grid Labeling and … 2020-10-07
Open Information Extraction OpenIE4 OpenIE6: Iterative Grid Labeling and … 2020-10-07
Open Information Extraction ClausIE OpenIE6: Iterative Grid Labeling and … 2020-10-07
Open Information Extraction SpanOIE OpenIE6: Iterative Grid Labeling and … 2020-10-07
Open Information Extraction MinIE OpenIE6: Iterative Grid Labeling and … 2020-10-07
Open Information Extraction RnnOIE OpenIE6: Iterative Grid Labeling and … 2020-10-07
Open Information Extraction CIGL-OIE + IGL-CA (OpenIE6) OpenIE6: Iterative Grid Labeling and … 2020-10-07
Open Information Extraction OpenIE5 OpenIE6: Iterative Grid Labeling and … 2020-10-07
Open Information Extraction MinIE Gashteovski et al. (2017) WiRe57 : A Fine-Grained Benchmark … 2018-09-24
Open Information Extraction Stanford Angeli et al. (2015) WiRe57 : A Fine-Grained Benchmark … 2018-09-24
Open Information Extraction OpenIE 4 Mausam (2016) WiRe57 : A Fine-Grained Benchmark … 2018-09-24
Open Information Extraction PropS Stanovsky et al. (2016) WiRe57 : A Fine-Grained Benchmark … 2018-09-24
Open Information Extraction ClausIE Del Corro and Gemulla (2013) WiRe57 : A Fine-Grained Benchmark … 2018-09-24
Open Information Extraction Ollie Mausam et al. (2012) WiRe57 : A Fine-Grained Benchmark … 2018-09-24
Open Information Extraction ReVerb Fader et al. (2011) WiRe57 : A Fine-Grained Benchmark … 2018-09-24

Research Papers

Recent papers with results on this dataset:

External Links: