ML Research Wiki / Benchmarks / Out-of-Distribution Detection / ImageNet-1k vs iNaturalist

ImageNet-1k vs iNaturalist

Out-of-Distribution Detection Benchmark

Performance Over Time

📊 Showing 24 results | 📏 Metric: AUROC

Top Performing Models

Rank	Model	Paper	AUROC	Date	Code
1	CMA(ViT-B/16, NegLabel)	Enhanced OoD Detection through Cross-Modal Alignment of Multi-Modal Representations	99.62	2025-03-24	📦 ma-kjh/CMA-OoDD
2	NNGuide (RegNet)	Nearest Neighbor Guidance for Out-of-Distribution Detection	99.57	2023-09-26	📦 jingkang50/openood 📦 roomo7time/nnguide
3	ViM (ViT-B/16)	ViM: Out-Of-Distribution with Virtual-logit Matching	99.41	2022-03-21	📦 jingkang50/openood 📦 haoqiwang/vim
4	DisCoPatch	DisCoPatch: Taming Adversarially-driven Batch Statistics for Improved Out-of-Distribution Detection	99.10	2025-01-14	-
5	SCALE (ResNet50)	Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancement	98.17	2023-09-30	📦 kai422/scale
6	MOS (BiT-S-R101x1)	MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space	98.15	2021-05-05	📦 deeplearning-wisc/large_scale_ood 📦 deeplearning-wisc/gradnorm_ood 📦 ma-kjh/CMA-OoDD 📦 tmlr-group/neglabel 📦 tmlr-group/class_prior
7	ASH-S (ResNet-50)	Extremely Simple Activation Shaping for Out-of-Distribution Detection	97.87	2022-09-20	📦 andrijazz/ash 📦 litianliu/fdbd-ood
8	NNGuide (ResNet50 w/ ReAct)	Nearest Neighbor Guidance for Out-of-Distribution Detection	97.70	2023-09-26	📦 jingkang50/openood 📦 roomo7time/nnguide
9	BATS (ResNet-50)	Boosting Out-of-distribution Detection with Typical Features	97.67	2022-10-09	-
10	LINe (ResNet-50)	LINe: Out-of-Distribution Detection by Leveraging Important Neurons	97.56	2023-03-24	📦 yonghyun-ahn/line-out-of-distribution-detection-by-leveraging-important-neurons

All Papers (24)

Enhanced OoD Detection through Cross-Modal Alignment of Multi-Modal Representations

2025

CMA(ViT-B/16, NegLabel)

ma-kjh/CMA-OoDD

Nearest Neighbor Guidance for Out-of-Distribution Detection

2023

NNGuide (RegNet)

jingkang50/openood roomo7time/nnguide

ViM: Out-Of-Distribution with Virtual-logit Matching

2022

ViM (ViT-B/16)

jingkang50/openood haoqiwang/vim

DisCoPatch: Taming Adversarially-driven Batch Statistics for Improved Out-of-Distribution Detection

2025

DisCoPatch

Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancement

2023

SCALE (ResNet50)

kai422/scale

MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space

2021

MOS (BiT-S-R101x1)

deeplearning-wisc/large_scale_ood deeplearning-wisc/gradnorm_ood

Extremely Simple Activation Shaping for Out-of-Distribution Detection

2022

ASH-S (ResNet-50)

andrijazz/ash litianliu/fdbd-ood

Nearest Neighbor Guidance for Out-of-Distribution Detection

2023

NNGuide (ResNet50 w/ ReAct)

jingkang50/openood roomo7time/nnguide

Boosting Out-of-distribution Detection with Typical Features

2022

BATS (ResNet-50)

LINe: Out-of-Distribution Detection by Leveraging Important Neurons

2023

LINe (ResNet-50)

yonghyun-ahn/line-out-of-distribution-detection-by-leveraging-important-neurons

Neuron Activation Coverage: Rethinking Out-of-distribution Detection and Generalization

2023

NAC-UE (ResNet-50)

bierone/ood_coverage

DICE: Leveraging Sparsification for Out-of-Distribution Detection

2021

DICE + ReAct (ResNet-50)

deeplearning-wisc/dice

Non-Parametric Outlier Synthesis

2023

NPOS

deeplearning-wisc/npos

Delving into Out-of-Distribution Detection with Vision-Language Representations

2022

MCM (CLIP-L)

deeplearning-wisc/mcm HHU-MMBS/plp-official-tmlr2024

Out-of-Distribution Detection with Deep Nearest Neighbors

2022

KNN (ResNet-50 SupCon)

deeplearning-wisc/knn-ood ArthurHoa/deep-eknn munhouiani/ood-knn

Unleashing Mask: Explore the Intrinsic Out-of-Distribution Detection Capability

2023

ODIN+UMAP (ResNet-50)

tmlr-group/unleashing-mask

Delving into Out-of-Distribution Detection with Vision-Language Representations

2022

MCM (CLIP-B)

deeplearning-wisc/mcm HHU-MMBS/plp-official-tmlr2024

RankFeat: Rank-1 Feature Removal for Out-of-distribution Detection

2022

RankFeat (ResNetv2-101)

kingjamessong/rankfeat

ReAct: Out-of-distribution Detection With Rectified Activations

2021

ReAct (ResNet-50)

deeplearning-wisc/react

Rethinking Out-of-distribution (OOD) Detection: Masked Image Modeling is All You Need

2023

MOOD

dvlab-research/mood julietljy/mood

Out-of-Distribution Detection with Deep Nearest Neighbors

2022

KNN (ResNet-50)

deeplearning-wisc/knn-ood ArthurHoa/deep-eknn munhouiani/ood-knn

Out-of-distribution Detection with Implicit Outlier Transformation

2023

DOE

qizhouwang/doe

On the Importance of Gradients for Detecting Distributional Shifts in the Wild

2021

GradNorm

deeplearning-wisc/gradnorm_ood

Forte : Finding Outliers with Representation Typicality Estimation

2024

Forte

DebarghaG/forte

Model	Paper	AUROC	Date
CMA(ViT-B/16, NegLabel)	Enhanced OoD Detection through Cross-Modal Alignm…	99.62	2025-03-24
NNGuide (RegNet)	Nearest Neighbor Guidance for Out-of-Distribution…	99.57	2023-09-26
ViM (ViT-B/16)	ViM: Out-Of-Distribution with Virtual-logit Match…	99.41	2022-03-21
DisCoPatch	DisCoPatch: Taming Adversarially-driven Batch Sta…	99.10	2025-01-14
SCALE (ResNet50)	Scaling for Training Time and Post-hoc Out-of-dis…	98.17	2023-09-30
MOS (BiT-S-R101x1)	MOS: Towards Scaling Out-of-distribution Detectio…	98.15	2021-05-05
ASH-S (ResNet-50)	Extremely Simple Activation Shaping for Out-of-Di…	97.87	2022-09-20
NNGuide (ResNet50 w/ ReAct)	Nearest Neighbor Guidance for Out-of-Distribution…	97.70	2023-09-26
BATS (ResNet-50)	Boosting Out-of-distribution Detection with Typic…	97.67	2022-10-09
LINe (ResNet-50)	LINe: Out-of-Distribution Detection by Leveraging…	97.56	2023-03-24
NAC-UE (ResNet-50)	Neuron Activation Coverage: Rethinking Out-of-dis…	96.52	2023-06-05
DICE + ReAct (ResNet-50)	DICE: Leveraging Sparsification for Out-of-Distri…	96.24	2021-11-18
NPOS	Non-Parametric Outlier Synthesis	96.19	2023-03-06
MCM (CLIP-L)	Delving into Out-of-Distribution Detection with V…	94.95	2022-11-24
KNN (ResNet-50 SupCon)	Out-of-Distribution Detection with Deep Nearest N…	94.72	2022-04-13
ODIN+UMAP (ResNet-50)	Unleashing Mask: Explore the Intrinsic Out-of-Dis…	94.71	2023-06-06
MCM (CLIP-B)	Delving into Out-of-Distribution Detection with V…	94.61	2022-11-24
RankFeat (ResNetv2-101)	RankFeat: Rank-1 Feature Removal for Out-of-distr…	91.91	2022-09-18
ReAct (ResNet-50)	ReAct: Out-of-distribution Detection With Rectifi…	91.53	2021-11-24
MOOD	Rethinking Out-of-distribution (OOD) Detection: M…	86.90	2023-02-06
KNN (ResNet-50)	Out-of-Distribution Detection with Deep Nearest N…	86.20	2022-04-13
DOE	Out-of-distribution Detection with Implicit Outli…	85.98	2023-03-09
GradNorm	On the Importance of Gradients for Detecting Dist…	50.03	2021-10-01
Forte	Forte : Finding Outliers with Representation Typi…		2024-10-02

ImageNet-1k vs iNaturalist

Performance Over Time

Edit Benchmark Results

Edit Result

Top Performing Models

All Papers (24)

Enhanced OoD Detection through Cross-Modal Alignment of Multi-Modal Representations

Nearest Neighbor Guidance for Out-of-Distribution Detection

ViM: Out-Of-Distribution with Virtual-logit Matching

DisCoPatch: Taming Adversarially-driven Batch Statistics for Improved Out-of-Distribution Detection

Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancement

MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space

Extremely Simple Activation Shaping for Out-of-Distribution Detection

Nearest Neighbor Guidance for Out-of-Distribution Detection

Boosting Out-of-distribution Detection with Typical Features

LINe: Out-of-Distribution Detection by Leveraging Important Neurons

Neuron Activation Coverage: Rethinking Out-of-distribution Detection and Generalization

DICE: Leveraging Sparsification for Out-of-Distribution Detection

Non-Parametric Outlier Synthesis

Delving into Out-of-Distribution Detection with Vision-Language Representations

Out-of-Distribution Detection with Deep Nearest Neighbors

Unleashing Mask: Explore the Intrinsic Out-of-Distribution Detection Capability

Delving into Out-of-Distribution Detection with Vision-Language Representations

RankFeat: Rank-1 Feature Removal for Out-of-distribution Detection

ReAct: Out-of-distribution Detection With Rectified Activations

Rethinking Out-of-distribution (OOD) Detection: Masked Image Modeling is All You Need

Out-of-Distribution Detection with Deep Nearest Neighbors

Out-of-distribution Detection with Implicit Outlier Transformation

On the Importance of Gradients for Detecting Distributional Shifts in the Wild

Forte : Finding Outliers with Representation Typicality Estimation