ML Research Wiki / Benchmarks / Relation Classification / TACRED

TACRED

Relation Classification Benchmark

Performance Over Time

📊 Showing 17 results | 📏 Metric: F1

Top Performing Models

Rank Model Paper F1 Date Code
1 DeepStruct multi-task w/ finetune DeepStruct: Pretraining of Language Models for Structure Prediction 76.80 2022-05-21 📦 cgraywang/deepstruct
2 DeepEx (zero-shot top-10) Zero-Shot Information Extraction as a Unified Text-to-Triple Translation 76.40 2021-09-23 📦 cgraywang/deepex
3 DeepStruct multi-task DeepStruct: Pretraining of Language Models for Structure Prediction 74.90 2022-05-21 📦 cgraywang/deepstruct
4 LUKE 483M LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention 72.70 2020-10-02 📦 huggingface/transformers 📦 PaddlePaddle/PaddleNLP 📦 studio-ousia/luke
5 K-Adapter K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters 72.00 2020-02-05 📦 microsoft/K-Adapter 📦 stevekgyang/sccl
6 TANL Structured Prediction as Translation between Augmented Natural Languages 71.90 2021-01-14 📦 amazon-science/tanl 📦 amazon-research/tanl
7 KEPLER KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation 71.70 2019-11-13 📦 THU-KEG/KEPLER
8 MTB Baldini Soares et al. (2019) Matching the Blanks: Distributional Similarity for Relation Learning 71.50 2019-06-07 📦 plkmo/BERT-Relation-Extraction 📦 diffbot/knowledge-net 📦 uf-hobi-informatics-lab/ClinicalTransformerRelationExtraction
9 KnowBERT Knowledge Enhanced Contextual Word Representations 71.50 2019-09-09 📦 allenai/kb
10 RoBERTa K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters 71.30 2020-02-05 📦 microsoft/K-Adapter 📦 stevekgyang/sccl

All Papers (17)