ML Research Wiki / Benchmarks / Out-of-Distribution Detection / ImageNet-1k vs SUN

ImageNet-1k vs SUN

Out-of-Distribution Detection Benchmark

Performance Over Time

📊 Showing 19 results | 📏 Metric: FPR95

Top Performing Models

Rank	Model	Paper	FPR95	Date	Code
1	CMA(ViT-B/16, NegLabel)	Enhanced OoD Detection through Cross-Modal Alignment of Multi-Modal Representations	96.36	2025-03-24	📦 ma-kjh/CMA-OoDD
2	LINe (ResNet50)	LINe: Out-of-Distribution Detection by Leveraging Important Neurons	95.26	2023-03-24	📦 yonghyun-ahn/line-out-of-distribution-detection-by-leveraging-important-neurons
3	SCALE (ResNet50)	Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancement	95.02	2023-09-30	📦 kai422/scale
4	NNGuide (RegNet) 📚	Nearest Neighbor Guidance for Out-of-Distribution Detection	94.43	2023-09-26	📦 jingkang50/openood 📦 roomo7time/nnguide
5	MCM (CLIP-L)	Delving into Out-of-Distribution Detection with Vision-Language Representations	94.14	2022-11-24	📦 deeplearning-wisc/mcm 📦 HHU-MMBS/plp-official-tmlr2024
6	RankFeat (ResNetv2-101)	RankFeat: Rank-1 Feature Removal for Out-of-distribution Detection	94.07	2022-09-18	📦 kingjamessong/rankfeat
7	ASH-S (ResNet-50)	Extremely Simple Activation Shaping for Out-of-Distribution Detection	94.02	2022-09-20	📦 andrijazz/ash 📦 litianliu/fdbd-ood
8	DICE + ReAct (ResNet-50)	DICE: Leveraging Sparsification for Out-of-Distribution Detection	93.94	2021-11-18	📦 deeplearning-wisc/dice
9	MCM (CLIP-B)	Delving into Out-of-Distribution Detection with Vision-Language Representations	92.57	2022-11-24	📦 deeplearning-wisc/mcm 📦 HHU-MMBS/plp-official-tmlr2024
10	MOS (BiT-S-R101x1) 📚	MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space	92.01	2021-05-05	📦 deeplearning-wisc/large_scale_ood 📦 deeplearning-wisc/gradnorm_ood 📦 ma-kjh/CMA-OoDD 📦 tmlr-group/neglabel 📦 tmlr-group/class_prior

All Papers (19)

Enhanced OoD Detection through Cross-Modal Alignment of Multi-Modal Representations

2025

CMA(ViT-B/16, NegLabel)

ma-kjh/CMA-OoDD

LINe: Out-of-Distribution Detection by Leveraging Important Neurons

2023

LINe (ResNet50)

yonghyun-ahn/line-out-of-distribution-detection-by-leveraging-important-neurons

Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancement

2023

SCALE (ResNet50)

kai422/scale

Nearest Neighbor Guidance for Out-of-Distribution Detection

2023

NNGuide (RegNet)

jingkang50/openood roomo7time/nnguide

Delving into Out-of-Distribution Detection with Vision-Language Representations

2022

MCM (CLIP-L)

deeplearning-wisc/mcm HHU-MMBS/plp-official-tmlr2024

RankFeat: Rank-1 Feature Removal for Out-of-distribution Detection

2022

RankFeat (ResNetv2-101)

kingjamessong/rankfeat

Extremely Simple Activation Shaping for Out-of-Distribution Detection

2022

ASH-S (ResNet-50)

andrijazz/ash litianliu/fdbd-ood

DICE: Leveraging Sparsification for Out-of-Distribution Detection

2021

DICE + ReAct (ResNet-50)

deeplearning-wisc/dice

Delving into Out-of-Distribution Detection with Vision-Language Representations

2022

MCM (CLIP-B)

deeplearning-wisc/mcm HHU-MMBS/plp-official-tmlr2024

MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space

2021

MOS (BiT-S-R101x1)

deeplearning-wisc/large_scale_ood deeplearning-wisc/gradnorm_ood

DICE: Leveraging Sparsification for Out-of-Distribution Detection

2021

DICE (ResNet-50)

deeplearning-wisc/dice

Non-Parametric Outlier Synthesis

2023

NPOS

deeplearning-wisc/npos

Rethinking Out-of-distribution (OOD) Detection: Masked Image Modeling is All You Need

2023

MOOD

dvlab-research/mood julietljy/mood

Out-of-Distribution Detection with Deep Nearest Neighbors

2022

KNN (ResNet-50 SupCon)

deeplearning-wisc/knn-ood ArthurHoa/deep-eknn munhouiani/ood-knn

ReAct: Out-of-distribution Detection With Rectified Activations

2021

ReAct (ResNet-50)

deeplearning-wisc/react

Unleashing Mask: Explore the Intrinsic Out-of-Distribution Detection Capability

2023

ODIN+UMAP (ResNet-50)

tmlr-group/unleashing-mask

Out-of-Distribution Detection with Deep Nearest Neighbors

2022

KNN (ResNet-50)

deeplearning-wisc/knn-ood ArthurHoa/deep-eknn munhouiani/ood-knn

Out-of-distribution Detection with Implicit Outlier Transformation

2023

DOE

qizhouwang/doe

On the Importance of Gradients for Detecting Distributional Shifts in the Wild

2021

GradNorm (ResNetv2-101)

deeplearning-wisc/gradnorm_ood

ImageNet-1k vs SUN

Performance Over Time

Edit Benchmark Results

Edit Result

Top Performing Models

All Papers (19)

Enhanced OoD Detection through Cross-Modal Alignment of Multi-Modal Representations

LINe: Out-of-Distribution Detection by Leveraging Important Neurons

Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancement

Nearest Neighbor Guidance for Out-of-Distribution Detection

Delving into Out-of-Distribution Detection with Vision-Language Representations

RankFeat: Rank-1 Feature Removal for Out-of-distribution Detection

Extremely Simple Activation Shaping for Out-of-Distribution Detection

DICE: Leveraging Sparsification for Out-of-Distribution Detection

Delving into Out-of-Distribution Detection with Vision-Language Representations

MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space

DICE: Leveraging Sparsification for Out-of-Distribution Detection

Non-Parametric Outlier Synthesis

Rethinking Out-of-distribution (OOD) Detection: Masked Image Modeling is All You Need

Out-of-Distribution Detection with Deep Nearest Neighbors

ReAct: Out-of-distribution Detection With Rectified Activations

Unleashing Mask: Explore the Intrinsic Out-of-Distribution Detection Capability

Out-of-Distribution Detection with Deep Nearest Neighbors

Out-of-distribution Detection with Implicit Outlier Transformation

On the Importance of Gradients for Detecting Distributional Shifts in the Wild

Model	Paper	FPR95	Date
CMA(ViT-B/16, NegLabel)	Enhanced OoD Detection through Cross-Modal Alignm…	96.36	2025-03-24
LINe (ResNet50)	LINe: Out-of-Distribution Detection by Leveraging…	95.26	2023-03-24
SCALE (ResNet50)	Scaling for Training Time and Post-hoc Out-of-dis…	95.02	2023-09-30
NNGuide (RegNet)	Nearest Neighbor Guidance for Out-of-Distribution…	94.43	2023-09-26
MCM (CLIP-L)	Delving into Out-of-Distribution Detection with V…	94.14	2022-11-24
RankFeat (ResNetv2-101)	RankFeat: Rank-1 Feature Removal for Out-of-distr…	94.07	2022-09-18
ASH-S (ResNet-50)	Extremely Simple Activation Shaping for Out-of-Di…	94.02	2022-09-20
DICE + ReAct (ResNet-50)	DICE: Leveraging Sparsification for Out-of-Distri…	93.94	2021-11-18
MCM (CLIP-B)	Delving into Out-of-Distribution Detection with V…	92.57	2022-11-24
MOS (BiT-S-R101x1)	MOS: Towards Scaling Out-of-distribution Detectio…	92.01	2021-05-05
DICE (ResNet-50)	DICE: Leveraging Sparsification for Out-of-Distri…	90.83	2021-11-18
NPOS	Non-Parametric Outlier Synthesis	90.44	2023-03-06
MOOD	Rethinking Out-of-distribution (OOD) Detection: M…	89.80	2023-02-06
KNN (ResNet-50 SupCon)	Out-of-Distribution Detection with Deep Nearest N…	88.40	2022-04-13
ReAct (ResNet-50)	ReAct: Out-of-distribution Detection With Rectifi…	88.16	2021-11-24
ODIN+UMAP (ResNet-50)	Unleashing Mask: Explore the Intrinsic Out-of-Dis…	86.92	2023-06-06
KNN (ResNet-50)	Out-of-Distribution Detection with Deep Nearest N…	80.10	2022-04-13
DOE	Out-of-distribution Detection with Implicit Outli…	76.26	2023-03-09
GradNorm (ResNetv2-101)	On the Importance of Gradients for Detecting Dist…	46.48	2021-10-01