NYUv2

NYU-Depth V2

Dataset Information
Modalities
RGB-D
Introduced
2012
License
Unknown
Homepage
Official Website
Contents

Overview

The NYU-Depth V2 data set is comprised of video sequences from a variety of indoor scenes as recorded by both the RGB and Depth cameras from the Microsoft Kinect. It features:

  • 1449 densely labeled pairs of aligned RGB and depth images
  • 464 new scenes taken from 3 cities
  • 407,024 new unlabeled frames
  • Each object is labeled with a class and an instance number.
    The dataset has several components:
  • Labeled: A subset of the video data accompanied by dense multi-class labels. This data has also been preprocessed to fill in missing depth labels.
  • Raw: The raw RGB, depth and accelerometer data as provided by the Kinect.
  • Toolbox: Useful functions for manipulating the data and labels.

Source: https://cs.nyu.edu/~silberman/datasets/nyu_depth_v2.html
Image Source: https://cs.nyu.edu/~silberman/datasets/nyu_depth_v2.html

Variants: NYU-Depth V2, NYU Depth v2, NYU-Depth V2 Surface Normals, NYUv2, NYU-Depth V2 self-supervised

Associated Benchmarks

This dataset is used in 2 benchmarks:

Recent Benchmark Submissions

Task Model Paper Date
Multi-Task Learning SwinMTL SwinMTL: A Shared Architecture for … 2024-03-15
3D Semantic Scene Completion OccDepth OccDepth: A Depth-Aware Method for … 2023-02-27
Multi-Task Learning Nash-MTL Multi-Task Learning as a Bargaining … 2022-02-02
3D Semantic Scene Completion Point-Voxel Aggregation Network Not All Voxels Are Equal: … 2021-12-24
3D Semantic Scene Completion MonoScene (RGB input only) MonoScene: Monocular 3D Semantic Scene … 2021-12-01
3D Semantic Scene Completion SPAwN (SUNCG pretraining) Data Augmented 3D Semantic Scene … 2021-11-26
3D Semantic Scene Completion SPAwN Data Augmented 3D Semantic Scene … 2021-11-26
3D Semantic Scene Completion SISNet Semantic Scene Completion via Integrating … 2021-04-08
3D Semantic Scene Completion 3D semantic scene completion from a single depth image using adversarial training 3D Semantic Scene Completion: a … 2021-03-12
3D Semantic Scene Completion Real-time semantic scene completion via feature aggregation and conditioned prediction 3D Semantic Scene Completion: a … 2021-03-12
3D Semantic Scene Completion EdgeNet (SUNCG pretraining) 3D Semantic Scene Completion: a … 2021-03-12
3D Semantic Scene Completion VD-CRF: Semantic scene completion with dense CRF from a single depth image. (SUNCG pretraining) 3D Semantic Scene Completion: a … 2021-03-12
3D Semantic Scene Completion Am2fnet: Attention-based multiscale & multi-modality fused network 3D Semantic Scene Completion: a … 2021-03-12
3D Semantic Scene Completion LMSCNet-SS LMSCNet: Lightweight Multiscale 3D Semantic … 2020-08-24
3D Semantic Scene Completion AIC-Net Anisotropic Convolutional Networks for 3D … 2020-04-05
3D Semantic Scene Completion AMFNet Attention-based Multi-modal Fusion Network for … 2020-03-31
3D Semantic Scene Completion 3DSketch 3D Sketch-aware Semantic Scene Completion … 2020-03-31
3D Semantic Scene Completion GRFNet 3D Gated Recurrent Fusion for … 2020-02-17
3D Semantic Scene Completion ForkNet (SUNCG pretraining) ForkNet: Multi-branch Volumetric Semantic Completion … 2019-09-03
3D Semantic Scene Completion EdgeNet EdgeNet: Semantic Scene Completion from … 2019-08-08

Research Papers

Recent papers with results on this dataset:

External Links: