ML Research Wiki / Benchmarks / Named Entity Recognition (NER) / CoNLL++

CoNLL++

Named Entity Recognition (NER) Benchmark

Performance Over Time

📊 Showing 11 results | 📏 Metric: F1

Top Performing Models

Rank	Model	Paper	F1	Date	Code
1	LUKE + SubRegWeigh (K-means)	SubRegWeigh: Effective and Efficient Annotation Weighing with Subword Regularization	96.12	2024-09-10	📦 4ldk/SubRegWeigh
2	LUKE（Large）	LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention	95.89	2020-10-02	📦 huggingface/transformers 📦 PaddlePaddle/PaddleNLP 📦 studio-ousia/luke
3	Noise-robust Co-regularization + LUKE	Learning from Noisy Labels for Entity-Centric Information Extraction	95.60	2021-04-17	📦 wzhouad/NLL-IE
4	RoBERTa + SubRegWeigh (K-means)	SubRegWeigh: Effective and Efficient Annotation Weighing with Subword Regularization	95.45	2024-09-10	📦 4ldk/SubRegWeigh
5	CL-KL	Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning	94.81	2021-05-08	📦 modelscope/adaseq 📦 modelscope/AdaSeq 📦 Alibaba-NLP/CLNER
6	CrossWeigh + Pooled Flair 📚	CrossWeigh: Training Named Entity Tagger from Imperfect Annotations	94.28	2019-09-03	📦 ZihanWangKi/CrossWeigh
7	Pooled Flair 📚	CrossWeigh: Training Named Entity Tagger from Imperfect Annotations	94.13	2019-09-03	📦 ZihanWangKi/CrossWeigh
8	Noise-robust Co-regularization + BERT-large	Learning from Noisy Labels for Entity-Centric Information Extraction	94.04	2021-04-17	📦 wzhouad/NLL-IE
9	BiLSTM-CRF+ELMo	Deep contextualized word representations	93.42	2018-02-15	📦 flairNLP/flair 📦 dmlc/gluon-nlp 📦 allenai/bilm-tf
10	BiLSTM-CNN-CRF	End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF	91.87	2016-03-04	📦 guillaumegenthial/sequence_tagging 📦 guillaumegenthial/tf_ner 📦 achernodub/targer

All Papers (11)

SubRegWeigh: Effective and Efficient Annotation Weighing with Subword Regularization

2024

LUKE + SubRegWeigh (K-means)

4ldk/SubRegWeigh

LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention

2020

LUKE（Large）

huggingface/transformers PaddlePaddle/PaddleNLP

Learning from Noisy Labels for Entity-Centric Information Extraction

2021

Noise-robust Co-regularization + LUKE

wzhouad/NLL-IE

SubRegWeigh: Effective and Efficient Annotation Weighing with Subword Regularization

2024

RoBERTa + SubRegWeigh (K-means)

4ldk/SubRegWeigh

Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning

2021

CL-KL

modelscope/adaseq modelscope/AdaSeq Alibaba-NLP/CLNER

CrossWeigh: Training Named Entity Tagger from Imperfect Annotations

2019

CrossWeigh + Pooled Flair

ZihanWangKi/CrossWeigh

CrossWeigh: Training Named Entity Tagger from Imperfect Annotations

2019

Pooled Flair

ZihanWangKi/CrossWeigh

Learning from Noisy Labels for Entity-Centric Information Extraction

2021

Noise-robust Co-regularization + BERT-large

wzhouad/NLL-IE

Deep contextualized word representations

2018

BiLSTM-CRF+ELMo

flairNLP/flair dmlc/gluon-nlp

End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF

2016

BiLSTM-CNN-CRF

guillaumegenthial/sequence_tagging guillaumegenthial/tf_ner

Neural Architectures for Named Entity Recognition

2016

LSTM-CRF

flairNLP/flair deepmipt/DeepPavlov

CoNLL++

Performance Over Time

Edit Benchmark Results

Edit Result

Top Performing Models

All Papers (11)

SubRegWeigh: Effective and Efficient Annotation Weighing with Subword Regularization

LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention

Learning from Noisy Labels for Entity-Centric Information Extraction

SubRegWeigh: Effective and Efficient Annotation Weighing with Subword Regularization

Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning

CrossWeigh: Training Named Entity Tagger from Imperfect Annotations

CrossWeigh: Training Named Entity Tagger from Imperfect Annotations

Learning from Noisy Labels for Entity-Centric Information Extraction

Deep contextualized word representations

End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF

Neural Architectures for Named Entity Recognition

Model	Paper	F1	Date
LUKE + SubRegWeigh (K-means)	SubRegWeigh: Effective and Efficient Annotation W…	96.12	2024-09-10
LUKE（Large）	LUKE: Deep Contextualized Entity Representations …	95.89	2020-10-02
Noise-robust Co-regularization + LUKE	Learning from Noisy Labels for Entity-Centric Inf…	95.60	2021-04-17
RoBERTa + SubRegWeigh (K-means)	SubRegWeigh: Effective and Efficient Annotation W…	95.45	2024-09-10
CL-KL	Improving Named Entity Recognition by External Co…	94.81	2021-05-08
CrossWeigh + Pooled Flair	CrossWeigh: Training Named Entity Tagger from Imp…	94.28	2019-09-03
Pooled Flair	CrossWeigh: Training Named Entity Tagger from Imp…	94.13	2019-09-03
Noise-robust Co-regularization + BERT-large	Learning from Noisy Labels for Entity-Centric Inf…	94.04	2021-04-17
BiLSTM-CRF+ELMo	Deep contextualized word representations	93.42	2018-02-15
BiLSTM-CNN-CRF	End-to-end Sequence Labeling via Bi-directional L…	91.87	2016-03-04
LSTM-CRF	Neural Architectures for Named Entity Recognition	91.47	2016-03-04