ML Research Wiki / Benchmarks / Text Classification / DBpedia

DBpedia

Text Classification Benchmark

Performance Over Time

📊 Showing 19 results | 📏 Metric: Error

Top Performing Models

Rank	Model	Paper	Error	Date	Code
1	XLNet	XLNet: Generalized Autoregressive Pretraining for Language Understanding	0.62	2019-06-19	📦 huggingface/transformers 📦 PaddlePaddle/PaddleNLP 📦 zihangdai/xlnet
2	Bidirectional Encoder Representations from Transformers	BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding	0.64	2018-10-11	📦 huggingface/transformers 📦 tensorflow/models 📦 labmlai/annotated_deep_learning_paper_implementations
3	BERT large	Unsupervised Data Augmentation for Consistency Training	0.68	2019-04-29	📦 google-research/uda 📦 SanghunYun/UDA_pytorch 📦 ildoonet/unsupervised-data-augmentation
4	BERT-ITPT-FiT	How to Fine-Tune BERT for Text Classification?	0.68	2019-05-14	📦 xuyige/BERT4doc-Classification 📦 ongunuzaymacar/comparatively-finetuning-bert 📦 uzaymacar/comparatively-finetuning-bert
5	L MIXED	Revisiting LSTM Networks for Semi-Supervised Text Classification via Mixed Objective Function	0.70	2020-09-08	📦 DevSinghSachan/ssl_text_classification
6	ULMFiT	Universal Language Model Fine-tuning for Text Classification	0.80	2018-01-18	📦 fastai/fastai 📦 mrdbourke/tensorflow-deep-learning 📦 Socialbird-AILab/BERT-Classification-Tutorial
7	ULMFiT (Small data)	Sampling Bias in Deep Active Classification: An Empirical Study	0.80	2019-09-20	📦 Xtra-Computing/thundersvm 📦 drimpossible/Sampling-Bias-Active-Learning
8	CNN	Supervised and Semi-Supervised Text Categorization using LSTM for Region Embeddings	0.84	2016-02-07	-
9	LEAM	Joint Embedding of Words and Labels for Text Classification	0.98	2018-05-10	📦 guoyinwang/LEAM 📦 ShuanDeMorian/Project_AT_News_Classification
10	EXAM	Explicit Interaction Model towards Text Classification	1.00	2018-11-23	📦 NonvolatileMemory/AAAI_2019_EXAM

All Papers (19)

XLNet: Generalized Autoregressive Pretraining for Language Understanding

2019

XLNet

huggingface/transformers PaddlePaddle/PaddleNLP

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

2018

Bidirectional Encoder Representations from Transformers

huggingface/transformers tensorflow/models

Unsupervised Data Augmentation for Consistency Training

2019

BERT large

google-research/uda SanghunYun/UDA_pytorch

How to Fine-Tune BERT for Text Classification?

2019

BERT-ITPT-FiT

xuyige/BERT4doc-Classification ongunuzaymacar/comparatively-finetuning-bert

Revisiting LSTM Networks for Semi-Supervised Text Classification via Mixed Objective Function

2020

L MIXED

DevSinghSachan/ssl_text_classification

Universal Language Model Fine-tuning for Text Classification

2018

ULMFiT

fastai/fastai mrdbourke/tensorflow-deep-learning

Sampling Bias in Deep Active Classification: An Empirical Study

2019

ULMFiT (Small data)

Xtra-Computing/thundersvm drimpossible/Sampling-Bias-Active-Learning

Supervised and Semi-Supervised Text Categorization using LSTM for Region Embeddings

2016

CNN

Joint Embedding of Words and Labels for Text Classification

2018

LEAM

guoyinwang/LEAM ShuanDeMorian/Project_AT_News_Classification

Explicit Interaction Model towards Text Classification

2018

EXAM

NonvolatileMemory/AAAI_2019_EXAM

Learning Context-Sensitive Convolutional Filters for Text Processing

2017

M-ACNN

Unsupervised Data Augmentation for Consistency Training

2019

BERT large UDA

google-research/uda SanghunYun/UDA_pytorch

On Tree-Based Neural Sentence Modeling

2018

Balanced+bi-leaf-RNN

ExplorerFreda/TreeEnc

Compositional Coding Capsule Network with K-Means Routing for Text Classification

2018

CCCapsNet

leftthomas/CCCapsNet

Very Deep Convolutional Networks for Text Classification

2016

VDCN

dongjun-Lee/text-classification-models-tf zonetrooper32/VDCNN

Bag of Tricks for Efficient Text Classification

2016

FastText

facebookresearch/fastText graykode/nlp-tutorial

Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling Mechanisms

2018

SWEM-concat

dinghanshen/SWEM nyk510/scdv-python

Character-level Convolutional Networks for Text Classification

2015

Char-level CNN

makcedward/nlpaug gaussic/text-classification-cnn-rnn

Abstractive Text Classification Using Sequence-to-convolution Neural Networks

2018

Seq2CNN(50)

tgisaturday/Seq2CNN

DBpedia

Performance Over Time

Edit Benchmark Results

Edit Result

Top Performing Models

All Papers (19)

XLNet: Generalized Autoregressive Pretraining for Language Understanding

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Unsupervised Data Augmentation for Consistency Training

How to Fine-Tune BERT for Text Classification?

Revisiting LSTM Networks for Semi-Supervised Text Classification via Mixed Objective Function

Universal Language Model Fine-tuning for Text Classification

Sampling Bias in Deep Active Classification: An Empirical Study

Supervised and Semi-Supervised Text Categorization using LSTM for Region Embeddings

Joint Embedding of Words and Labels for Text Classification

Explicit Interaction Model towards Text Classification

Learning Context-Sensitive Convolutional Filters for Text Processing

Unsupervised Data Augmentation for Consistency Training

On Tree-Based Neural Sentence Modeling

Compositional Coding Capsule Network with K-Means Routing for Text Classification

Very Deep Convolutional Networks for Text Classification

Bag of Tricks for Efficient Text Classification

Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling Mechanisms

Character-level Convolutional Networks for Text Classification

Abstractive Text Classification Using Sequence-to-convolution Neural Networks

Model	Paper	Error	Date
XLNet	XLNet: Generalized Autoregressive Pretraining for…	0.62	2019-06-19
Bidirectional Encoder Representations from Transformers	BERT: Pre-training of Deep Bidirectional Transfor…	0.64	2018-10-11
BERT large	Unsupervised Data Augmentation for Consistency Tr…	0.68	2019-04-29
BERT-ITPT-FiT	How to Fine-Tune BERT for Text Classification?	0.68	2019-05-14
L MIXED	Revisiting LSTM Networks for Semi-Supervised Text…	0.70	2020-09-08
ULMFiT	Universal Language Model Fine-tuning for Text Cla…	0.80	2018-01-18
ULMFiT (Small data)	Sampling Bias in Deep Active Classification: An E…	0.80	2019-09-20
CNN	Supervised and Semi-Supervised Text Categorizatio…	0.84	2016-02-07
LEAM	Joint Embedding of Words and Labels for Text Clas…	0.98	2018-05-10
EXAM	Explicit Interaction Model towards Text Classific…	1.00	2018-11-23
M-ACNN	Learning Context-Sensitive Convolutional Filters …	1.07	2017-09-25
BERT large UDA	Unsupervised Data Augmentation for Consistency Tr…	1.09	2019-04-29
Balanced+bi-leaf-RNN	On Tree-Based Neural Sentence Modeling	1.20	2018-08-29
CCCapsNet	Compositional Coding Capsule Network with K-Means…	1.28	2018-10-22
VDCN	Very Deep Convolutional Networks for Text Classif…	1.29	2016-06-06
FastText	Bag of Tricks for Efficient Text Classification	1.40	2016-07-06
SWEM-concat	Baseline Needs More Love: On Simple Word-Embeddin…	1.43	2018-05-24
Char-level CNN	Character-level Convolutional Networks for Text C…	1.55	2015-09-04
Seq2CNN(50)	Abstractive Text Classification Using Sequence-to…	2.77	2018-05-20