A RGB-D dataset converted from NYUDv2 into COCO-style instance segmentation format.
To construct NYUDv2-IS, specifically tailored for instance segmentation, we generated instance masks that delineate individual objects in each image. These masks were labeled using the object class annotations provided in the original NYUDv2 dataset, which is distributed in MATLAB format. The process involved several key steps: (1) extracting binary instance masks, (2) converting these masks into polygon representations, and (3) generating COCO-style annotations. Each annotation includes essential attributes such as category ID, segmentation masks, bounding boxes, object areas, and image metadata. During this conversion, we focused on 9 categories out of the original 13 classes, excluding non-instance categories such as walls and floors. To ensure dataset quality, images without any object annotations were systematically removed.
Variants: NYUDv2-IS
This dataset is used in 1 benchmark:
Task | Model | Paper | Date |
---|---|---|---|
Instance Segmentation | IAM + SOLQ | IAM: Enhancing RGB-D Instance Segmentation … | 2025-01-03 |
Instance Segmentation | IAM + DETR | IAM: Enhancing RGB-D Instance Segmentation … | 2025-01-03 |
Recent papers with results on this dataset: