KoNViD-1k

KoNViD-1k VQA Database

Dataset Information
Modalities
Videos
Languages
English
Introduced
2017
License
Creative Commons
Homepage

Overview

Subjective video quality assessment (VQA) strongly depends on semantics, context, and the types of visual distortions. A lot of existing VQA databases cover small numbers of video sequences with artificial distortions. When testing newly developed Quality of Experience (QoE) models and metrics, they are commonly evaluated against subjective data from such databases, that are the result of perception experiments. However, since the aim of these QoE models is to accurately predict natural videos, these artificially distorted video databases are an insufficient basis for learning. Additionally, the small sizes make them only marginally usable for state-of-the-art learning systems, such as deep learning. In order to give a better basis for development and evaluation of objective VQA methods, we have created a larger datasets of natural, real-world video sequences with corresponding subjective mean opinion scores (MOS) gathered through crowdsourcing.

We took YFCC100m as a baseline database, consisting of 793436 Creative Commons (CC) video sequences, filtered them through multiple steps to ensure that the video sequences are representative of the whole spectrum of available video content, types of distortions, and subjective quality. The resulting 1200 videos are available to download, alongside the subjective data and evaluation of the best-performing techniques available for multiple video attributes. Namely, we have evaluated blur, colorfulness, contrast, spatial information, temporal information and video quality.

Variants: KoNViD-1k

Associated Benchmarks

This dataset is used in 1 benchmark:

Recent Benchmark Submissions

Task Model Paper Date
Video Quality Assessment ReLaX-VQA ReLaX-VQA: Residual Fragment and Layer … 2024-07-16
Video Quality Assessment ReLaX-VQA (finetuned on KoNViD-1k) ReLaX-VQA: Residual Fragment and Layer … 2024-07-16
Video Quality Assessment ReLaX-VQA (trained on LSVQ only) ReLaX-VQA: Residual Fragment and Layer … 2024-07-16
Video Quality Assessment DOVER (end-to-end) Exploring Video Quality Assessment on … 2022-11-09
Video Quality Assessment DOVER (head-only) Exploring Video Quality Assessment on … 2022-11-09
Video Quality Assessment FasterVQA (fine-tuned) Neighbourhood Representative Sampling for Efficient … 2022-10-11
Video Quality Assessment HVS-5M HVS Revisited: A Comprehensive Video … 2022-10-09
Video Quality Assessment 2BiVQA 2BiVQA: Double Bi-LSTM based Video … 2022-08-31
Video Quality Assessment FAST-VQA (finetuned on KonViD-1k) FAST-VQA: Efficient End-to-end Video Quality … 2022-07-06
Video Quality Assessment FAST-VQA (trained on LSVQ only) FAST-VQA: Efficient End-to-end Video Quality … 2022-07-06
Video Quality Assessment CONVIQT CONVIQT: Contrastive Video Quality Estimator 2022-06-29
Video Quality Assessment DisCoVQA DisCoVQA: Temporal Distortion-Content Transformers for … 2022-06-20
Video Quality Assessment SimpleVQA A Deep Learning based No-reference … 2022-04-29
Video Quality Assessment CONTRIQUE Image Quality Assessment using Contrastive … 2021-10-25
Video Quality Assessment ChipQA ChipQA: No-Reference Video Quality Prediction … 2021-09-17
Video Quality Assessment BVQA-2022 Blindly Assess Quality of In-the-Wild … 2021-08-19
Video Quality Assessment RAPIQUE RAPIQUE: Rapid and Accurate Video … 2021-01-26
Video Quality Assessment PVQ Patch-VQ: 'Patching Up' the Video … 2020-11-27
Video Quality Assessment VIDEVAL UGC-VQA: Benchmarking Blind Video Quality … 2020-05-29
Video Quality Assessment VSFA Quality Assessment of In-the-Wild Videos 2019-08-01

Research Papers

Recent papers with results on this dataset: