UHD-IQA

Dataset Information
Modalities
Images
Introduced
2024
License
CC0
Homepage

Overview

We introduce a novel Image Quality Assessment (IQA) dataset comprising 6073 UHD-1 (4K) images, annotated at a fixed width of 3840 pixels. Contrary to existing No-Reference (NR) IQA datasets, ours focuses on highly aesthetic photos of high technical quality, filling a gap in the literature. The images, carefully curated to exclude synthetic content, are sufficiently diverse to train general NR-IQA models. Importantly, the dataset is annotated with perceptual quality ratings obtained through a crowdsourcing study. Ten expert raters, comprising photographers and graphics artists, assessed each image at least twice in multiple sessions spanning several days, resulting in highly reliable labels. Annotators were rigorously selected based on several metrics, including self-consistency, to ensure their reliability. The dataset includes rich metadata with user and machine-generated tags from over 5,000 categories and popularity indicators such as favorites, likes, downloads, and views. With its unique characteristics, such as its focus on high-quality images, reliable crowdsourced annotations, and high annotation resolution, our dataset opens up new opportunities for advancing perceptual image quality assessment research and developing practical NRIQA models that apply to modern photos.

Variants: UHD-IQA

Associated Benchmarks

This dataset is used in 1 benchmark:

Recent Benchmark Submissions

Task Model Paper Date
No-Reference Image Quality Assessment LAR-IQA (KAN head) LAR-IQA: A Lightweight, Accurate, and … 2024-08-30
No-Reference Image Quality Assessment QualiCLIP Quality-Aware Image-Text Alignment for Real-World … 2024-03-17
No-Reference Image Quality Assessment ARNIQA ARNIQA: Learning Distortion Manifold for … 2023-10-20
No-Reference Image Quality Assessment Effnet-2C-MLSP KonX: Cross-Resolution Image Quality Assessment 2022-12-12
No-Reference Image Quality Assessment CLIP-IQA+ Exploring CLIP for Assessing the … 2022-07-25
No-Reference Image Quality Assessment CONTRIQUE Image Quality Assessment using Contrastive … 2021-10-25

Research Papers

Recent papers with results on this dataset: