ML Research Wiki / Benchmarks / Image Classification / Colored-MNIST(with spurious correlation)

Colored-MNIST(with spurious correlation)

Image Classification Benchmark

Performance Over Time

📊 Showing 6 results | 📏 Metric: Accuracy

Top Performing Models

Rank Model Paper Accuracy Date Code
1 MLP-DecAug DecAug: Out-of-Distribution Generalization via Decomposed Feature Representation and Semantic Augmentation 69.60 2020-12-17 📦 HaoyueBaiZJU/DecAug
2 MLP-REx Out-of-Distribution Generalization via Risk Extrapolation (REx) 68.70 2020-03-02 📦 thuml/Transfer-Learning-Library 📦 facebookresearch/DomainBed 📦 capybaralet/REx_code_release 📦 lingxiaoyuan/ood_mechanics
3 MLP-IRM Invariant Risk Minimization 66.90 2019-07-05 📦 thuml/Transfer-Learning-Library 📦 facebookresearch/DomainBed 📦 facebookresearch/InvariantRiskMinimization
4 F-IRMGames Invariant Risk Minimization Games 59.91 2020-02-11 📦 IBM/OoD 📦 IBM/OoD 📦 epfl-dlab/invariant-language-models
5 MLP-ERM Empirical Risk Minimization for Stochastic Convex Optimization: $O(1/n)$- and $O(1/n^2)$-type of Risk Bounds 17.10 2017-02-07 -
6 JiGen Domain Generalization by Solving Jigsaw Puzzles 11.91 2019-03-16 📦 fmcarlucci/JigenDG 📦 Emma0118/domain-generalization

All Papers (6)