MCubeS

Multimodal Material Segmentation Dataset

Dataset Information
Modalities
Images, Hyperspectral images
Languages
English
Introduced
2022
License
MiT
Homepage
Official Website
Contents

Overview

Multimodal material segmentation (MCubeS) dataset contains 500 sets of images from 42 street scenes. Each scene has images for four modalities: RGB, angle of linear polarization (AoLP), degree of linear polarization (DoLP), and near-infrared (NIR). The dataset provides annotated ground truth labels for both material and semantic segmentation for every pixel. The dataset is divided training set with 302 image sets, validation set with 96 image sets, and test set with 102 image sets. Each image has 1224 x 1024 pixels and a total of 20 class labels per pixel.

Variants: MCubeS

Associated Benchmarks

This dataset is used in 1 benchmark:

Recent Benchmark Submissions

Task Model Paper Date
Semantic Segmentation MemorySAM-B+(RGB-A-D) MemorySAM: Memorize Modalities and Semantics … 2025-03-09
Semantic Segmentation MemorySAM-B+(RGB-A-D-N) MemorySAM: Memorize Modalities and Semantics … 2025-03-09
Semantic Segmentation MemorySAM-B+(RGB-A) MemorySAM: Memorize Modalities and Semantics … 2025-03-09
Semantic Segmentation StitchFusion (RGB-N) StitchFusion: Weaving Any Visual Modalities … 2024-08-02
Semantic Segmentation StitchFusion (RGB-A) StitchFusion: Weaving Any Visual Modalities … 2024-08-02
Semantic Segmentation StitchFusion (RGB-D) StitchFusion: Weaving Any Visual Modalities … 2024-08-02
Semantic Segmentation StitchFusion (RGB-A-D-N) StitchFusion: Weaving Any Visual Modalities … 2024-08-02
Semantic Segmentation StitchFusion (RGB-A-D) StitchFusion: Weaving Any Visual Modalities … 2024-08-02
Semantic Segmentation ShareCMP(B2 RGB-A) ShareCMP: Polarization-Aware RGB-P Semantic Segmentation 2023-12-06
Semantic Segmentation ShareCMP (B2 RGB-A-D) ShareCMP: Polarization-Aware RGB-P Semantic Segmentation 2023-12-06
Semantic Segmentation ShareCMP(B2 RGB-D) ShareCMP: Polarization-Aware RGB-P Semantic Segmentation 2023-12-06
Semantic Segmentation MMSFormer (RGB) MMSFormer: Multimodal Transformer for Material … 2023-09-07
Semantic Segmentation MMSFormer (RGB-A) MMSFormer: Multimodal Transformer for Material … 2023-09-07
Semantic Segmentation MMSFormer (RGB-A-D-N) MMSFormer: Multimodal Transformer for Material … 2023-09-07
Semantic Segmentation MMSFormer (RGB-A-D) MMSFormer: Multimodal Transformer for Material … 2023-09-07
Semantic Segmentation CMNeXt (B2 RGB-A-D) Delivering Arbitrary-Modal Semantic Segmentation 2023-03-02
Semantic Segmentation CMNeXt (B2 RGB-A) Delivering Arbitrary-Modal Semantic Segmentation 2023-03-02
Semantic Segmentation CMNeXt (B2 RGB-A-D-N) Delivering Arbitrary-Modal Semantic Segmentation 2023-03-02
Semantic Segmentation DDF (RGB-A-D-N) Decoupled Dynamic Filter Networks 2021-04-29
Semantic Segmentation DRConv (RGB-A-D-N) Dynamic Region-Aware Convolution 2020-03-27

Research Papers

Recent papers with results on this dataset:

External Links: