ML Research Wiki / Benchmarks / Domain Generalization / ImageNet-A

ImageNet-A

Domain Generalization Benchmark

Performance Over Time

📊 Showing 39 results | 📏 Metric: Top-1 accuracy %

Top Performing Models

Rank Model Paper Top-1 accuracy % Date Code
1 Model soups (BASIC-L) 📚 Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time 94.17 2022-03-10 📦 mlfoundations/model-soups 📦 Burf/ModelSoups 📦 facebookresearch/ModelRatatouille
2 Model soups (ViT-G/14) 📚 Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time 92.67 2022-03-10 📦 mlfoundations/model-soups 📦 Burf/ModelSoups 📦 facebookresearch/ModelRatatouille
3 µ2Net+ (ViT-L/16) 📚 A Continual Development Methodology for Large-scale Multitask Dynamic ML Systems 84.53 2022-09-15 📦 google-research/google-research
4 CAR-FT (CLIP, ViT-L/14@336px) 📚 Context-Aware Robust Fine-Tuning 81.50 2022-11-29 -
5 CAFormer-B36 (IN-21K, 384) 📚 MetaFormer Baselines for Vision 79.50 2022-10-24 📦 rwightman/pytorch-image-models 📦 facebookresearch/xformers 📦 sail-sg/poolformer
6 MAE (ViT-H, 448) Masked Autoencoders Are Scalable Vision Learners 76.70 2021-11-11 📦 facebookresearch/mae 📦 lightly-ai/lightly 📦 open-mmlab/mmselfsup
7 FAN-Hybrid-L(IN-21K, 384) 📚 Understanding The Robustness in Vision Transformers 74.50 2022-04-26 📦 nvlabs/fan 📦 NVlabs/STL
8 ConvFormer-B36 (IN-21K, 384) 📚 MetaFormer Baselines for Vision 73.50 2022-10-24 📦 rwightman/pytorch-image-models 📦 facebookresearch/xformers 📦 sail-sg/poolformer
9 CAFormer-B36 (IN-21K) 📚 MetaFormer Baselines for Vision 69.40 2022-10-24 📦 rwightman/pytorch-image-models 📦 facebookresearch/xformers 📦 sail-sg/poolformer
10 ConvNeXt-XL (Im21k, 384) 📚 A ConvNet for the 2020s 69.30 2022-01-10 📦 keras-team/keras 📦 rwightman/pytorch-image-models 📦 pytorch/vision

All Papers (39)

Context-Aware Robust Fine-Tuning

2022
CAR-FT (CLIP, ViT-L/14@336px)

Pyramid Adversarial Training Improves ViT Performance

2021
Pyramid Adversarial Training Improves ViT (Im21k)

Pyramid Adversarial Training Improves ViT Performance

2021
Pyramid Adversarial Training Improves ViT (384x384)