VizWiz-Classification

Dataset Information
Modalities
Images
Introduced
2023
License
Unknown
Homepage
Official Website
Contents

Overview

Our goal is to improve upon the status quo for designing image classification models trained in one domain that perform well on images from another domain. Complementing existing work in robustness testing, we introduce the first test dataset for this purpose which comes from an authentic use case where photographers wanted to learn about the content in their images. We built a new test set using 8,900 images taken by people who are blind for which we collected metadata to indicate the presence versus absence of 200 ImageNet object categories. We call this dataset VizWiz-Classification.

Variants: VizWiz-Classification

Associated Benchmarks

This dataset is used in 3 benchmarks:

Recent Benchmark Submissions

Task Model Paper Date
Domain Generalization ConvNeXt-B A ConvNet for the 2020s 2022-01-10
Domain Generalization ResNet-50 (gn) ResNet strikes back: An improved … 2021-10-01
Domain Generalization VOLO-D5 VOLO: Vision Outlooker for Visual … 2021-06-24
Image Classification VOLO-D5 VOLO: Vision Outlooker for Visual … 2021-06-24
Domain Generalization ViT-16/L-224 An Image is Worth 16x16 … 2020-10-22
Domain Generalization ViT-8/B-224 An Image is Worth 16x16 … 2020-10-22
Domain Generalization ResNet-50 (IN-C_fog_aws) Measuring Robustness to Natural Distribution … 2020-07-01
Domain Generalization ResNet-50 (IN-C_saturate) Measuring Robustness to Natural Distribution … 2020-07-01
Domain Generalization ResNet-50 (IN-C_motion_blur) Measuring Robustness to Natural Distribution … 2020-07-01
Domain Generalization ResNet-50 (IN-C_jpeg_compression) Measuring Robustness to Natural Distribution … 2020-07-01
Domain Generalization ResNet-50 (IN-C_frost) Measuring Robustness to Natural Distribution … 2020-07-01
Domain Generalization ResNet-50 (IN-C) Measuring Robustness to Natural Distribution … 2020-07-01
Domain Generalization ResNet-50 (IN-C_pixelate) Measuring Robustness to Natural Distribution … 2020-07-01
Domain Generalization ResNet-50 (IN-C_contrast) Measuring Robustness to Natural Distribution … 2020-07-01
Domain Generalization ResNet-50 (IN-C_spatter) Measuring Robustness to Natural Distribution … 2020-07-01
Domain Generalization ResNet-50 (IN-C_zoom_blur) Measuring Robustness to Natural Distribution … 2020-07-01
Domain Generalization ResNet-50 (IN-C_brightness) Measuring Robustness to Natural Distribution … 2020-07-01
Domain Generalization ResNet-50 (IN-C_gaussian_noise) Measuring Robustness to Natural Distribution … 2020-07-01
Domain Generalization ResNet-50 (IN-C_greyscale) Measuring Robustness to Natural Distribution … 2020-07-01
Domain Generalization ResNet-50 (deepaugment+augmix) The Many Faces of Robustness: … 2020-06-29

Research Papers

Recent papers with results on this dataset:

External Links: