CaRB

Crowdsourced automatic open Relation extraction Benchmark

Dataset Information
Introduced
2019
License
Unknown
Homepage
Official Website
Contents

Overview

CaRB [Bhardwaj et al., 2019] is developed by re-annotating the dev and test splits of OIE2016 via crowd-sourcing. Besides improving annotation quality, CaRB also provides a new matching scorer. CaRB scorer uses token level match and it matches relation with relation, arguments with arguments.

Source: https://arxiv.org/pdf/2205.11725.pdf (section 3.1)

Variants: CaRB

Associated Benchmarks

This dataset is used in 1 benchmark:

Recent Benchmark Submissions

Task Model Paper Date
Open Information Extraction LLaMA-2-13B w/ Selected Demo & Uncertainty Improving Open Information Extraction with … 2023-09-07
Open Information Extraction GPT-3.5-Turbo w/ Selected Demo & Uncertainty Improving Open Information Extraction with … 2023-09-07
Open Information Extraction LLaMA-2-70B w/ Selected Demo & Uncertainty Improving Open Information Extraction with … 2023-09-07
Open Information Extraction SenseOIE [30] A Survey on Neural Open … 2022-05-24
Open Information Extraction IMoJIE A Survey on Neural Open … 2022-05-24
Open Information Extraction OpenIE6 A Survey on Neural Open … 2022-05-24
Open Information Extraction Multi2OIE A Survey on Neural Open … 2022-05-24
Open Information Extraction OpenIE4 A Survey on Neural Open … 2022-05-24
Open Information Extraction NOIE A Survey on Neural Open … 2022-05-24
Open Information Extraction RnnOIE A Survey on Neural Open … 2022-05-24
Open Information Extraction SpanOIE [48] A Survey on Neural Open … 2022-05-24
Open Information Extraction ClausIE [9] A Survey on Neural Open … 2022-05-24
Open Information Extraction MacroIE A Survey on Neural Open … 2022-05-24
Open Information Extraction MinIE OpenIE6: Iterative Grid Labeling and … 2020-10-07
Open Information Extraction OpenIE 6 (CIGL-OIE) OpenIE6: Iterative Grid Labeling and … 2020-10-07
Open Information Extraction SpanOIE OpenIE6: Iterative Grid Labeling and … 2020-10-07
Open Information Extraction IMoJIE OpenIE6: Iterative Grid Labeling and … 2020-10-07
Open Information Extraction RnnOIE OpenIE6: Iterative Grid Labeling and … 2020-10-07
Open Information Extraction OpenIE5 OpenIE6: Iterative Grid Labeling and … 2020-10-07
Open Information Extraction ClausIE OpenIE6: Iterative Grid Labeling and … 2020-10-07

Research Papers

Recent papers with results on this dataset:

External Links: