NYUDv2-IS

Dataset Information
Modalities
Images, RGB-D
Introduced
2025
License
Unknown
Homepage

Overview

A RGB-D dataset converted from NYUDv2 into COCO-style instance segmentation format.
To construct NYUDv2-IS, specifically tailored for instance segmentation, we generated instance masks that delineate individual objects in each image. These masks were labeled using the object class annotations provided in the original NYUDv2 dataset, which is distributed in MATLAB format. The process involved several key steps: (1) extracting binary instance masks, (2) converting these masks into polygon representations, and (3) generating COCO-style annotations. Each annotation includes essential attributes such as category ID, segmentation masks, bounding boxes, object areas, and image metadata. During this conversion, we focused on 9 categories out of the original 13 classes, excluding non-instance categories such as walls and floors. To ensure dataset quality, images without any object annotations were systematically removed.

Variants: NYUDv2-IS

Associated Benchmarks

This dataset is used in 1 benchmark:

Recent Benchmark Submissions

Task Model Paper Date
Instance Segmentation IAM + SOLQ IAM: Enhancing RGB-D Instance Segmentation … 2025-01-03
Instance Segmentation IAM + DETR IAM: Enhancing RGB-D Instance Segmentation … 2025-01-03

Research Papers

Recent papers with results on this dataset: