ML Research Wiki / Benchmarks / Multi-Label Classification / CheXpert

CheXpert

Multi-Label Classification Benchmark

Performance Over Time

📊 Showing 11 results | 📏 Metric: AVERAGE AUC ON 14 LABEL

Top Performing Models

Rank	Model	Paper	AVERAGE AUC ON 14 LABEL	Date	Code
1	DeepAUC-v1	Large-scale Robust Deep AUC Maximization: A New Surrogate Loss and Empirical Studies on Medical Image Classification	0.93	2020-12-06	📦 Optimization-AI/LibAUC 📦 optimization-ai/iccv2021_deepauc 📦 yzhuoning/DeepAUC_OGB_Challenge 📦 chihchenghsieh/multimodal-medical-diagnosis-system
2	Hierarchical-Learning-V1 (ensemble)	Interpreting chest X-rays via CNNs that exploit hierarchical disease dependencies and uncertainty labels	0.93	2019-11-15	📦 thanhtran98/chexpert_pytorch_base 📦 covidscantest/covidscan-datascience
3	Hierarchical-Learning-V4 (ensemble)	Interpreting chest X-rays via CNNs that exploit hierarchical disease dependencies and uncertainty labels	0.93	2019-11-15	📦 thanhtran98/chexpert_pytorch_base 📦 covidscantest/covidscan-datascience
4	Anatomy-XNet-V1	Anatomy-XNet: An Anatomy Aware Convolutional Neural Network for Thoracic Disease Classification in Chest X-rays	0.93	2021-06-10	-
5	Anatomy-XNet (ensemble)	Anatomy-XNet: An Anatomy Aware Convolutional Neural Network for Thoracic Disease Classification in Chest X-rays	0.92	2021-06-10	-
6	Masks and Manuscripts	Masks and Manuscripts: Advancing Medical Pre-training with End-to-End Masking and Narrative Structuring	0.91	2024-07-23	-
7	Stanford Baseline (ensemble)	CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison	0.91	2019-01-21	📦 stanfordmlgroup/chexpert-labeler 📦 gaetandi/cheXpert 📦 stanfordmlgroup/MoCo-CXR
8	LBC-v2 (ensemble)	Image Projective Transformation Rectification with Synthetic Data for Smartphone-captured Chest X-ray Photos Classification	0.91	2022-10-12	📦 maxium0526/ptrn
9	LBC-v0 (ensemble)	Image Projective Transformation Rectification with Synthetic Data for Smartphone-captured Chest X-ray Photos Classification	0.90	2022-10-12	📦 maxium0526/ptrn
10	Stellarium-CheXpert-Local	Image Projective Transformation Rectification with Synthetic Data for Smartphone-captured Chest X-ray Photos Classification	0.90	2022-10-12	📦 maxium0526/ptrn

All Papers (11)

Large-scale Robust Deep AUC Maximization: A New Surrogate Loss and Empirical Studies on Medical Image Classification

2020

DeepAUC-v1

Optimization-AI/LibAUC optimization-ai/iccv2021_deepauc

Interpreting chest X-rays via CNNs that exploit hierarchical disease dependencies and uncertainty labels

2019

Hierarchical-Learning-V1 (ensemble)

thanhtran98/chexpert_pytorch_base covidscantest/covidscan-datascience

Interpreting chest X-rays via CNNs that exploit hierarchical disease dependencies and uncertainty labels

2019

Hierarchical-Learning-V4 (ensemble)

thanhtran98/chexpert_pytorch_base covidscantest/covidscan-datascience

Anatomy-XNet: An Anatomy Aware Convolutional Neural Network for Thoracic Disease Classification in Chest X-rays

2021

Anatomy-XNet-V1

Anatomy-XNet: An Anatomy Aware Convolutional Neural Network for Thoracic Disease Classification in Chest X-rays

2021

Anatomy-XNet (ensemble)

Masks and Manuscripts: Advancing Medical Pre-training with End-to-End Masking and Narrative Structuring

2024

Masks and Manuscripts

CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison

2019

Stanford Baseline (ensemble)

stanfordmlgroup/chexpert-labeler gaetandi/cheXpert

Image Projective Transformation Rectification with Synthetic Data for Smartphone-captured Chest X-ray Photos Classification

2022

LBC-v2 (ensemble)

maxium0526/ptrn

Image Projective Transformation Rectification with Synthetic Data for Smartphone-captured Chest X-ray Photos Classification

2022

LBC-v0 (ensemble)

maxium0526/ptrn

Image Projective Transformation Rectification with Synthetic Data for Smartphone-captured Chest X-ray Photos Classification

2022

Stellarium-CheXpert-Local

maxium0526/ptrn

CheXclusion: Fairness gaps in deep chest X-ray classifiers

2020

DensNet121

LalehSeyyed/CheXclusion

CheXpert

Performance Over Time

Edit Benchmark Results

Edit Result

Top Performing Models

All Papers (11)

Large-scale Robust Deep AUC Maximization: A New Surrogate Loss and Empirical Studies on Medical Image Classification

Interpreting chest X-rays via CNNs that exploit hierarchical disease dependencies and uncertainty labels

Interpreting chest X-rays via CNNs that exploit hierarchical disease dependencies and uncertainty labels

Anatomy-XNet: An Anatomy Aware Convolutional Neural Network for Thoracic Disease Classification in Chest X-rays

Anatomy-XNet: An Anatomy Aware Convolutional Neural Network for Thoracic Disease Classification in Chest X-rays

Masks and Manuscripts: Advancing Medical Pre-training with End-to-End Masking and Narrative Structuring

CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison

Image Projective Transformation Rectification with Synthetic Data for Smartphone-captured Chest X-ray Photos Classification

Image Projective Transformation Rectification with Synthetic Data for Smartphone-captured Chest X-ray Photos Classification

Image Projective Transformation Rectification with Synthetic Data for Smartphone-captured Chest X-ray Photos Classification

CheXclusion: Fairness gaps in deep chest X-ray classifiers

Model	Paper	AVERAGE AUC ON 14 LABEL	Date
DeepAUC-v1	Large-scale Robust Deep AUC Maximization: A New S…	0.93	2020-12-06
Hierarchical-Learning-V1 (ensemble)	Interpreting chest X-rays via CNNs that exploit h…	0.93	2019-11-15
Hierarchical-Learning-V4 (ensemble)	Interpreting chest X-rays via CNNs that exploit h…	0.93	2019-11-15
Anatomy-XNet-V1	Anatomy-XNet: An Anatomy Aware Convolutional Neur…	0.93	2021-06-10
Anatomy-XNet (ensemble)	Anatomy-XNet: An Anatomy Aware Convolutional Neur…	0.92	2021-06-10
Masks and Manuscripts	Masks and Manuscripts: Advancing Medical Pre-trai…	0.91	2024-07-23
Stanford Baseline (ensemble)	CheXpert: A Large Chest Radiograph Dataset with U…	0.91	2019-01-21
LBC-v2 (ensemble)	Image Projective Transformation Rectification wit…	0.91	2022-10-12
LBC-v0 (ensemble)	Image Projective Transformation Rectification wit…	0.90	2022-10-12
Stellarium-CheXpert-Local	Image Projective Transformation Rectification wit…	0.90	2022-10-12
DensNet121	CheXclusion: Fairness gaps in deep chest X-ray cl…	0.81	2020-02-14