ML Research Wiki / Benchmarks / 3D Semantic Scene Completion / NYUv2

NYUv2

3D Semantic Scene Completion Benchmark

Performance Over Time

📊 Showing 26 results | 📏 Metric: mIoU

Top Performing Models

Rank	Model	Paper	mIoU	Date	Code
1	SISNet	Semantic Scene Completion via Integrating Instances and Scene in-the-Loop	52.40	2021-04-08	📦 yjcaimeow/SISNet
2	SPAwN (SUNCG pretraining)	Data Augmented 3D Semantic Scene Completion with 2D Segmentation Priors	49.90	2021-11-26	📦 UnBVision/spawn
3	SPAwN	Data Augmented 3D Semantic Scene Completion with 2D Segmentation Priors	48.00	2021-11-26	📦 UnBVision/spawn
4	Point-Voxel Aggregation Network	Not All Voxels Are Equal: Semantic Scene Completion from the Point-Voxel Perspective	46.00	2021-12-24	-
5	CCPNet (SUNCG pretraining) 📚	Cascaded Context Pyramid for Full-Resolution 3D Semantic Scene Completion	41.30	2019-08-01	-
6	3DSketch	3D Sketch-aware Semantic Scene Completion via Semi-supervised Structure Prior	41.10	2020-03-31	📦 charlesCXK/3D-SketchAware-SSC 📦 charlesCXK/TorchSSC
7	ForkNet (SUNCG pretraining) 📚	ForkNet: Multi-branch Volumetric Semantic Completion from a Single Depth Image	37.10	2019-09-03	-
8	Real-time semantic scene completion via feature aggregation and conditioned prediction	3D Semantic Scene Completion: a Survey	34.40	2021-03-12	-
9	TS3D	Two Stream 3D Semantic Scene Completion	34.10	2018-04-10	-
10	EdgeNet (SUNCG pretraining) 📚	3D Semantic Scene Completion: a Survey	33.70	2021-03-12	-

All Papers (26)

Semantic Scene Completion via Integrating Instances and Scene in-the-Loop

2021

SISNet

yjcaimeow/SISNet

Data Augmented 3D Semantic Scene Completion with 2D Segmentation Priors

2021

SPAwN (SUNCG pretraining)

UnBVision/spawn

Data Augmented 3D Semantic Scene Completion with 2D Segmentation Priors

2021

SPAwN

UnBVision/spawn

Not All Voxels Are Equal: Semantic Scene Completion from the Point-Voxel Perspective

2021

Point-Voxel Aggregation Network

Cascaded Context Pyramid for Full-Resolution 3D Semantic Scene Completion

2019

CCPNet (SUNCG pretraining)

3D Sketch-aware Semantic Scene Completion via Semi-supervised Structure Prior

2020

3DSketch

charlesCXK/3D-SketchAware-SSC charlesCXK/TorchSSC

ForkNet: Multi-branch Volumetric Semantic Completion from a Single Depth Image

2019

ForkNet (SUNCG pretraining)

3D Semantic Scene Completion: a Survey

2021

Real-time semantic scene completion via feature aggregation and conditioned prediction

Two Stream 3D Semantic Scene Completion

2018

TS3D

3D Semantic Scene Completion: a Survey

2021

EdgeNet (SUNCG pretraining)

Anisotropic Convolutional Networks for 3D Semantic Scene Completion

2020

AIC-Net

waterljwant/SSC

Attention-based Multi-modal Fusion Network for Semantic Scene Completion

2020

AMFNet

3D Gated Recurrent Fusion for Semantic Scene Completion

2020

GRFNet

3D Semantic Scene Completion: a Survey

2021

VD-CRF: Semantic scene completion with dense CRF from a single depth image. (SUNCG pretraining)

3D Semantic Scene Completion: a Survey

2021

Am2fnet: Attention-based multiscale & multi-modality fused network

OccDepth: A Depth-Aware Method for 3D Semantic Scene Completion

2023

OccDepth

megvii-research/occdepth

Semantic Scene Completion from a Single Depth Image

2016

SSCNet (SUNCG pretraining)

facebookresearch/House3D shurans/sscnet krrish94/ssc

RGBD Based Dimensional Decomposition Residual Network for 3D Semantic Scene Completion

2019

DDRNet

View-volume Network for Semantic Scene Completion from a Single Depth Image

2018

VVNet

LMSCNet: Lightweight Multiscale 3D Semantic Completion

2020

LMSCNet-SS

astra-vision/lmscnet cv-rits/LMSCNet umich-curly/3dmapping

EdgeNet: Semantic Scene Completion from a Single RGB-D Image

2019

EdgeNet

UnBVision/edgenet

Semantic Scene Completion Combining Colour and Depth: preliminary experiments

2018

Guedes et al.

MonoScene: Monocular 3D Semantic Scene Completion

2021

MonoScene (RGB input only)

astra-vision/monoscene cv-rits/MonoScene

Efficient Semantic Scene Completion Network with Spatial Group Convolution

2019

ESSCNet

zjhthu/SGC-Release

Semantic Scene Completion from a Single Depth Image

2016

SSCNet

facebookresearch/House3D shurans/sscnet krrish94/ssc

3D Semantic Scene Completion: a Survey

2021

3D semantic scene completion from a single depth image using adversarial training

NYUv2

Performance Over Time

Edit Benchmark Results

Edit Result

Top Performing Models

All Papers (26)

Semantic Scene Completion via Integrating Instances and Scene in-the-Loop

Data Augmented 3D Semantic Scene Completion with 2D Segmentation Priors

Data Augmented 3D Semantic Scene Completion with 2D Segmentation Priors

Not All Voxels Are Equal: Semantic Scene Completion from the Point-Voxel Perspective

Cascaded Context Pyramid for Full-Resolution 3D Semantic Scene Completion

3D Sketch-aware Semantic Scene Completion via Semi-supervised Structure Prior

ForkNet: Multi-branch Volumetric Semantic Completion from a Single Depth Image

3D Semantic Scene Completion: a Survey

Two Stream 3D Semantic Scene Completion

3D Semantic Scene Completion: a Survey

Anisotropic Convolutional Networks for 3D Semantic Scene Completion

Attention-based Multi-modal Fusion Network for Semantic Scene Completion

3D Gated Recurrent Fusion for Semantic Scene Completion

3D Semantic Scene Completion: a Survey

3D Semantic Scene Completion: a Survey

OccDepth: A Depth-Aware Method for 3D Semantic Scene Completion

Semantic Scene Completion from a Single Depth Image

RGBD Based Dimensional Decomposition Residual Network for 3D Semantic Scene Completion

View-volume Network for Semantic Scene Completion from a Single Depth Image

LMSCNet: Lightweight Multiscale 3D Semantic Completion

EdgeNet: Semantic Scene Completion from a Single RGB-D Image

Semantic Scene Completion Combining Colour and Depth: preliminary experiments

MonoScene: Monocular 3D Semantic Scene Completion

Efficient Semantic Scene Completion Network with Spatial Group Convolution

Semantic Scene Completion from a Single Depth Image

3D Semantic Scene Completion: a Survey

Model	Paper	mIoU	Date
SISNet	Semantic Scene Completion via Integrating Instanc…	52.40	2021-04-08
SPAwN (SUNCG pretraining)	Data Augmented 3D Semantic Scene Completion with …	49.90	2021-11-26
SPAwN	Data Augmented 3D Semantic Scene Completion with …	48.00	2021-11-26
Point-Voxel Aggregation Network	Not All Voxels Are Equal: Semantic Scene Completi…	46.00	2021-12-24
CCPNet (SUNCG pretraining)	Cascaded Context Pyramid for Full-Resolution 3D S…	41.30	2019-08-01
3DSketch	3D Sketch-aware Semantic Scene Completion via Sem…	41.10	2020-03-31
ForkNet (SUNCG pretraining)	ForkNet: Multi-branch Volumetric Semantic Complet…	37.10	2019-09-03
Real-time semantic scene completion via feature aggregation and conditioned prediction	3D Semantic Scene Completion: a Survey	34.40	2021-03-12
TS3D	Two Stream 3D Semantic Scene Completion	34.10	2018-04-10
EdgeNet (SUNCG pretraining)	3D Semantic Scene Completion: a Survey	33.70	2021-03-12
AIC-Net	Anisotropic Convolutional Networks for 3D Semanti…	33.30	2020-04-05
AMFNet	Attention-based Multi-modal Fusion Network for Se…	33.00	2020-03-31
GRFNet	3D Gated Recurrent Fusion for Semantic Scene Comp…	32.90	2020-02-17
VD-CRF: Semantic scene completion with dense CRF from a single depth image. (SUNCG pretraining)	3D Semantic Scene Completion: a Survey	31.80	2021-03-12
Am2fnet: Attention-based multiscale & multi-modality fused network	3D Semantic Scene Completion: a Survey	31.70	2021-03-12
OccDepth	OccDepth: A Depth-Aware Method for 3D Semantic Sc…	30.90	2023-02-27
SSCNet (SUNCG pretraining)	Semantic Scene Completion from a Single Depth Ima…	30.50	2016-11-28
DDRNet	RGBD Based Dimensional Decomposition Residual Net…	30.40	2019-03-02
VVNet	View-volume Network for Semantic Scene Completion…	29.30	2018-06-14
LMSCNet-SS	LMSCNet: Lightweight Multiscale 3D Semantic Compl…	28.40	2020-08-24
EdgeNet	EdgeNet: Semantic Scene Completion from a Single …	27.80	2019-08-08
Guedes et al.	Semantic Scene Completion Combining Colour and De…	27.50	2018-02-13
MonoScene (RGB input only)	MonoScene: Monocular 3D Semantic Scene Completion	26.94	2021-12-01
ESSCNet	Efficient Semantic Scene Completion Network with …	26.70	2019-07-11
SSCNet	Semantic Scene Completion from a Single Depth Ima…	24.70	2016-11-28
3D semantic scene completion from a single depth image using adversarial training	3D Semantic Scene Completion: a Survey	22.70	2021-03-12