OIE2016

Dataset Information
Introduced
2016
License
Unknown
Contents

Overview

OIE2016 is the first large-scale OpenIE benchmark. It is created by automatic conversion from QA-SRL [He et al., 2015], a semantic role labeling dataset. The sentences are from news (e.g., WSJ) and encyclopedia (e.g., WIKI) domains. Since there are no restrictions on the elements of OpenIE extractions, partial-matching criteria instead of exact-matching is typically used. Hence, the evaluation script can tolerate the extractions that are slightly different from the gold annotation.

Source: https://arxiv.org/pdf/2205.11725.pdf (section 3.1)

Variants: OIE2016

Associated Benchmarks

This dataset is used in 1 benchmark:

Recent Benchmark Submissions

Task Model Paper Date
Open Information Extraction GPT-3.5-Turbo w/ Selected Demo & Uncertainty Improving Open Information Extraction with … 2023-09-07
Open Information Extraction LLaMA-2-70B w/ Selected Demo & Uncertainty Improving Open Information Extraction with … 2023-09-07
Open Information Extraction LLaMA-2-13B w/ Selected Demo & Uncertainty Improving Open Information Extraction with … 2023-09-07
Open Information Extraction OpenIE4 [26] A Survey on Neural Open … 2022-05-24
Open Information Extraction ClausIE [9] A Survey on Neural Open … 2022-05-24
Open Information Extraction SpanOIE [48] A Survey on Neural Open … 2022-05-24
Open Information Extraction RnnOIE [36] A Survey on Neural Open … 2022-05-24
Open Information Extraction DeepStruct multi-task w/ finetune DeepStruct: Pretraining of Language Models … 2022-05-21
Open Information Extraction Deepstruct multi-task DeepStruct: Pretraining of Language Models … 2022-05-21
Open Information Extraction Deepstruct zero-shot DeepStruct: Pretraining of Language Models … 2022-05-21
Open Information Extraction DeepEx (zero-shot) Zero-Shot Information Extraction as a … 2021-09-23
Open Information Extraction SpanOIE Span Model for Open Information … 2019-01-30

Research Papers

Recent papers with results on this dataset:

External Links: