OmniBenchmark

Dataset Information
Modalities
Images
Languages
English
Introduced
2022
License
Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License
Homepage
Official Website
Contents

Overview

Omni-Realm Benchmark (OmniBenchmark) is a diverse (21 semantic realm-wise datasets) and concise (realm-wise datasets have no concepts overlapping) benchmark for evaluating pre-trained model generalization across semantic super-concepts/realms, e.g. across mammals to aircraft.

[ECCV2022]

Variants: OmniBenchmark

Associated Benchmarks

This dataset is used in 1 benchmark:

Recent Benchmark Submissions

Task Model Paper Date
Image Classification NOAH-ViTB/16 Neural Prompt Search 2022-06-09
Image Classification Bamboo-R50 Bamboo: Building Mega-Scale Vision Dataset … 2022-03-15
Image Classification MAE Masked Autoencoders Are Scalable Vision … 2021-11-11
Image Classification BeiT BEiT: BERT Pre-Training of Image … 2021-06-15
Image Classification MLP-Mixer MLP-Mixer: An all-MLP Architecture for … 2021-05-04
Image Classification DINO Emerging Properties in Self-Supervised Vision … 2021-04-29
Image Classification SwinTransformer Swin Transformer: Hierarchical Vision Transformer … 2021-03-25
Image Classification CLIP-RN50 Learning Transferable Visual Models From … 2021-02-26
Image Classification ReLabel Re-labeling ImageNet: from Single to … 2021-01-13
Image Classification MEAL-V2 MEAL V2: Boosting Vanilla ResNet-50 … 2020-09-17
Image Classification MoPro-V2 MoPro: Webly Supervised Learning with … 2020-09-17
Image Classification SwAV Unsupervised Learning of Visual Features … 2020-06-17
Image Classification BiT-M Big Transfer (BiT): General Visual … 2019-12-24
Image Classification MoCoV2 Momentum Contrast for Unsupervised Visual … 2019-11-13
Image Classification EfficientNetB4 EfficientNet: Rethinking Model Scaling for … 2019-05-28
Image Classification CutMix CutMix: Regularization Strategy to Train … 2019-05-13
Image Classification IG-1B Billion-scale semi-supervised learning for image … 2019-05-02
Image Classification Adapter-ViTB/16 Parameter-Efficient Transfer Learning for NLP 2019-02-02
Image Classification Manifold Manifold Mixup: Better Representations by … 2018-06-13
Image Classification InceptionV4 Inception-v4, Inception-ResNet and the Impact … 2016-02-23

Research Papers

Recent papers with results on this dataset:

External Links: