ML Research Wiki / Benchmarks / Semantic Segmentation / PASCAL VOC 2012 test

PASCAL VOC 2012 test

Semantic Segmentation Benchmark

Performance Over Time

📊 Showing 51 results | 📏 Metric: Mean IoU

Top Performing Models

Rank	Model	Paper	Mean IoU	Date	Code
1	RRM	Reliability Does Matter: An End-to-End Weakly Supervised Semantic Segmentation Approach	66.50	2019-11-19	📦 zbf1991/RRM
2	SSDD	Self-Supervised Difference Detection for Weakly-Supervised Semantic Segmentation	65.50	2019-11-04	📦 shimoda-uec/ssdd
3	Light-Weight-RefineNet-50	Light-Weight RefineNet for Real-Time Semantic Segmentation	0.00	2018-10-08	📦 DrSleep/light-weight-refinenet 📦 AleksBanbur/EE8204---Real-Time-Multi-Task-Learning
4	CentraleSupelec Deep G-CRF	Fast, Exact and Multi-Scale Inference for Semantic Image Segmentation with Deep Gaussian CRFs	0.00	2016-03-28	📦 siddharthachandra/gcrf
5	DeepLabv3+ (Xception-65-JFT) 📚	Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation	0.00	2018-02-07	📦 tensorflow/models 📦 tensorflow/models 📦 open-mmlab/mmsegmentation
6	DeepLabv3+ (Xception-JFT) 📚	Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation	0.00	2018-02-07	📦 tensorflow/models 📦 tensorflow/models 📦 open-mmlab/mmsegmentation
7	DeepLabv3-JFT 📚	Rethinking Atrous Convolution for Semantic Image Segmentation	0.00	2017-06-17	📦 tensorflow/models 📦 tensorflow/models 📦 pytorch/vision
8	CASIA_IVA_SDN	Stacked Deconvolutional Network for Semantic Segmentation	0.00	2017-08-16	-
9	Smooth Network with Channel Attention Block	Learning a Discriminative Feature Network for Semantic Segmentation	0.00	2018-04-25	📦 ycszen/TorchSeg 📦 YuhuiMa/DFN-tensorflow 📦 akinoriosamura/TorchSeg-mirror
10	SANet (pretraining on COCO dataset)	Squeeze-and-Attention Networks for Semantic Segmentation	0.00	2019-09-08	📦 its-mayank/SqueezeAttention-PyTorch 📦 pwc-1/Paper-9 📦 MindCode-4/code-9 📦 MindCode-4/code-13

All Papers (51)

Reliability Does Matter: An End-to-End Weakly Supervised Semantic Segmentation Approach

2019

RRM

zbf1991/RRM

Self-Supervised Difference Detection for Weakly-Supervised Semantic Segmentation

2019

SSDD

shimoda-uec/ssdd

Light-Weight RefineNet for Real-Time Semantic Segmentation

2018

Light-Weight-RefineNet-50

DrSleep/light-weight-refinenet AleksBanbur/EE8204---Real-Time-Multi-Task-Learning

Fast, Exact and Multi-Scale Inference for Semantic Image Segmentation with Deep Gaussian CRFs

2016

CentraleSupelec Deep G-CRF

siddharthachandra/gcrf

Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation

2018

DeepLabv3+ (Xception-65-JFT)

tensorflow/models tensorflow/models

Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation

2018

DeepLabv3+ (Xception-JFT)

tensorflow/models tensorflow/models

Rethinking Atrous Convolution for Semantic Image Segmentation

2017

DeepLabv3-JFT

tensorflow/models tensorflow/models

Stacked Deconvolutional Network for Semantic Segmentation

2017

CASIA_IVA_SDN

Learning a Discriminative Feature Network for Semantic Segmentation

2018

Smooth Network with Channel Attention Block

ycszen/TorchSeg YuhuiMa/DFN-tensorflow akinoriosamura/TorchSeg-mirror

Squeeze-and-Attention Networks for Semantic Segmentation

2019

SANet (pretraining on COCO dataset)

its-mayank/SqueezeAttention-PyTorch pwc-1/Paper-9

Context Encoding for Semantic Segmentation

2018

EncNet

open-mmlab/mmsegmentation PaddlePaddle/PaddleSeg

Is Attention Better Than Matrix Decomposition?

2021

HamNet w/o COCO (ResNet-101)

Gsunshine/Enjoy-Hamburger plumprc/MTS-Mixers toqitahamid/gasformer

Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation

2019

Auto-DeepLab-L

tensorflow/models MenghaoGuo/AutoDeeplab

Pyramid Scene Parsing Network

2016

PSPNet

tensorflow/models tensorflow/models

Wider or Deeper: Revisiting the ResNet Model for Visual Recognition

2016

ResNet-38 MS COCO

itijyou/ademxapp halbielee/EPS ZhaoJ9014/shallower-wider-ResNet-Model-A-SW-ResNet-A

Segmentation Transformer: Object-Contextual Representations for Semantic Segmentation

2019

OCR (HRNetV2-W48)

open-mmlab/mmsegmentation PaddlePaddle/PaddleSeg

Segmentation Transformer: Object-Contextual Representations for Semantic Segmentation

2019

OCR (ResNet-101)

open-mmlab/mmsegmentation PaddlePaddle/PaddleSeg

RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentation

2016

Multipath-RefineNet

guosheng/refinenet mindspore-ai/models

ShelfNet for Fast Semantic Segmentation

2018

ShelfNet

Deci-AI/super-gradients juntang-zhuang/ShelfNet

Beyond Self-attention: External Attention using Two Linear Layers for Visual Tasks

2021

EANet (ResNet-101)

xmu-xiaoma666/External-Attention-pytorch MenghaoGuo/Awesome-Vision-Attentions

Large Kernel Matters -- Improve Semantic Segmentation by Global Convolutional Network

2017

Large Kernel Matters

y-ouali/pytorch_segmentation preritj/segmentation

Triply Supervised Decoder Networks for Joint Detection and Segmentation

2018

TripleNet

Squeeze-and-Attention Networks for Semantic Segmentation

2019

SANet

its-mayank/SqueezeAttention-PyTorch pwc-1/Paper-9

Understanding Convolution for Semantic Segmentation

2017

TuSimple

y-ouali/pytorch_segmentation TuSimple/TuSimple-DUC

Context Encoding for Semantic Segmentation

2018

EncNet (ResNet-101)

open-mmlab/mmsegmentation PaddlePaddle/PaddleSeg

Learning a Discriminative Feature Network for Semantic Segmentation

2018

DFN (ResNet-101)

ycszen/TorchSeg YuhuiMa/DFN-tensorflow akinoriosamura/TorchSeg-mirror

Not All Pixels Are Equal: Difficulty-aware Semantic Segmentation via Deep Layer Cascade

2017

Deep Layer Cascade (LC)

liuziwei7/region-conv

Light-Weight RefineNet for Real-Time Semantic Segmentation

2018

Light-Weight-RefineNet-152

DrSleep/light-weight-refinenet AleksBanbur/EE8204---Real-Time-Multi-Task-Learning

Dual Attention Network for Scene Segmentation

2018

DANet (ResNet-101)

xmu-xiaoma666/External-Attention-pytorch open-mmlab/mmsegmentation

Pyramid Scene Parsing Network

2016

PSPNet (ResNet-101)

tensorflow/models tensorflow/models

Light-Weight RefineNet for Real-Time Semantic Segmentation

2018

Light-Weight-RefineNet-101

DrSleep/light-weight-refinenet AleksBanbur/EE8204---Real-Time-Multi-Task-Learning

EdgeNeXt: Efficiently Amalgamated CNN-Transformer Architecture for Mobile Vision Applications

2022

EdgeNeXt

rwightman/pytorch-image-models leondgarse/keras_cv_attention_models

DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs

2016

DeepLab-CRF (ResNet-101)

tensorflow/models tensorflow/models

Waterfall Atrous Spatial Pooling Architecture for Efficient Semantic Segmentation

2019

WASPnet-CRF (ours)

bmartacho/WASP

Light-Weight RefineNet for Real-Time Semantic Segmentation

2018

Light-Weight-RefineNet-MobileNet-v2

DrSleep/light-weight-refinenet AleksBanbur/EE8204---Real-Time-Multi-Task-Learning

The Lovász-Softmax loss: A tractable surrogate for the optimization of the intersection-over-union measure in neural networks

2017

Deeplab-v2 with Lovasz-Softmax loss

CoinCheung/pytorch-loss bermanmaxim/LovaszSoftmax

The Lovász-Softmax loss: A tractable surrogate for the optimization of the intersection-over-union measure in neural networks

2017

Deeplab-v2 + Lovász-Softmax

CoinCheung/pytorch-loss bermanmaxim/LovaszSoftmax

Conditional Random Fields as Recurrent Neural Networks

2015

CRF-RNN

torrvision/crfasrnn sadeepj/crfasrnn_keras

Simple Does It: Weakly Supervised Instance and Semantic Segmentation

2016

SID

Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs

2014

DeepLab-MSc-CRF-LargeFOV (VGG-16)

tensorflow/models tensorflow/models

ParseNet: Looking Wider to See Better

2015

ParseNet

tensorflow/models tensorflow/models

Efficient Yet Deep Convolutional Neural Networks for Semantic Segmentation

2017

Dilated FCN-2s VGG19

SharifAmit/DilatedFCNSegmentation

ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network

2018

ESPNetv2

PaddlePaddle/PaddleSeg osmr/imgclsmob

Multi-Scale Context Aggregation by Dilated Convolutions

2015

Dilated Convolutions

fyu/dilation vlievin/Unet

DiCENet: Dimension-wise Convolutions for Efficient Networks

2019

DiCENet

osmr/imgclsmob sacmehta/EdgeNets

BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation

2015

BoxSup

Find it if You Can: End-to-End Adversarial Erasing for Weakly-Supervised Semantic Segmentation

2020

PSA w/ EADER DeepLab (Xception-65)

ErikStammes/EADER

ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation

2018

ESPNet

PaddlePaddle/PaddleSeg sacmehta/ESPNet

Fully Convolutional Networks for Semantic Segmentation

2014

FCN (VGG-16)

pochih/fcn-pytorch andyzeng/apc-vision-toolbox

Exploiting saliency for object segmentation from image level labels

2017

G2

Simultaneous Detection and Segmentation

2014

CK

Model	Paper	Mean IoU	Date
RRM	Reliability Does Matter: An End-to-End Weakly Sup…	66.50	2019-11-19
SSDD	Self-Supervised Difference Detection for Weakly-S…	65.50	2019-11-04
Light-Weight-RefineNet-50	Light-Weight RefineNet for Real-Time Semantic Seg…		2018-10-08
CentraleSupelec Deep G-CRF	Fast, Exact and Multi-Scale Inference for Semanti…		2016-03-28
DeepLabv3+ (Xception-65-JFT)	Encoder-Decoder with Atrous Separable Convolution…		2018-02-07
DeepLabv3+ (Xception-JFT)	Encoder-Decoder with Atrous Separable Convolution…		2018-02-07
DeepLabv3-JFT	Rethinking Atrous Convolution for Semantic Image …		2017-06-17
CASIA_IVA_SDN	Stacked Deconvolutional Network for Semantic Segm…		2017-08-16
Smooth Network with Channel Attention Block	Learning a Discriminative Feature Network for Sem…		2018-04-25
SANet (pretraining on COCO dataset)	Squeeze-and-Attention Networks for Semantic Segme…		2019-09-08
EncNet	Context Encoding for Semantic Segmentation		2018-03-23
HamNet w/o COCO (ResNet-101)	Is Attention Better Than Matrix Decomposition?		2021-09-09
Auto-DeepLab-L	Auto-DeepLab: Hierarchical Neural Architecture Se…		2019-01-10
PSPNet	Pyramid Scene Parsing Network		2016-12-04
ResNet-38 MS COCO	Wider or Deeper: Revisiting the ResNet Model for …		2016-11-30
OCR (HRNetV2-W48)	Segmentation Transformer: Object-Contextual Repre…		2019-09-24
OCR (ResNet-101)	Segmentation Transformer: Object-Contextual Repre…		2019-09-24
Multipath-RefineNet	RefineNet: Multi-Path Refinement Networks for Hig…		2016-11-20
ShelfNet	ShelfNet for Fast Semantic Segmentation		2018-11-27
EANet (ResNet-101)	Beyond Self-attention: External Attention using T…		2021-05-05
Large Kernel Matters	Large Kernel Matters -- Improve Semantic Segmenta…		2017-03-08
TripleNet	Triply Supervised Decoder Networks for Joint Dete…		2018-09-25
SANet	Squeeze-and-Attention Networks for Semantic Segme…		2019-09-08
TuSimple	Understanding Convolution for Semantic Segmentati…		2017-02-27
EncNet (ResNet-101)	Context Encoding for Semantic Segmentation		2018-03-23
DFN (ResNet-101)	Learning a Discriminative Feature Network for Sem…		2018-04-25
Deep Layer Cascade (LC)	Not All Pixels Are Equal: Difficulty-aware Semant…		2017-04-05
Light-Weight-RefineNet-152	Light-Weight RefineNet for Real-Time Semantic Seg…		2018-10-08
DANet (ResNet-101)	Dual Attention Network for Scene Segmentation		2018-09-09
PSPNet (ResNet-101)	Pyramid Scene Parsing Network		2016-12-04
Light-Weight-RefineNet-101	Light-Weight RefineNet for Real-Time Semantic Seg…		2018-10-08
EdgeNeXt	EdgeNeXt: Efficiently Amalgamated CNN-Transformer…		2022-06-21
DeepLab-CRF (ResNet-101)	DeepLab: Semantic Image Segmentation with Deep Co…		2016-06-02
WASPnet-CRF (ours)	Waterfall Atrous Spatial Pooling Architecture for…		2019-12-06
Light-Weight-RefineNet-MobileNet-v2	Light-Weight RefineNet for Real-Time Semantic Seg…		2018-10-08
Deeplab-v2 with Lovasz-Softmax loss	The Lovász-Softmax loss: A tractable surrogate fo…		2017-05-24
Deeplab-v2 + Lovász-Softmax	The Lovász-Softmax loss: A tractable surrogate fo…		2017-05-24
CRF-RNN	Conditional Random Fields as Recurrent Neural Net…		2015-02-11
SID	Simple Does It: Weakly Supervised Instance and Se…		2016-03-24
DeepLab-MSc-CRF-LargeFOV (VGG-16)	Semantic Image Segmentation with Deep Convolution…		2014-12-22
ParseNet	ParseNet: Looking Wider to See Better		2015-06-15
Dilated FCN-2s VGG19	Efficient Yet Deep Convolutional Neural Networks …		2017-07-26
ESPNetv2	ESPNetv2: A Light-weight, Power Efficient, and Ge…		2018-11-28
Dilated Convolutions	Multi-Scale Context Aggregation by Dilated Convol…		2015-11-23
DiCENet	DiCENet: Dimension-wise Convolutions for Efficien…		2019-06-08
BoxSup	BoxSup: Exploiting Bounding Boxes to Supervise Co…		2015-03-05
PSA w/ EADER DeepLab (Xception-65)	Find it if You Can: End-to-End Adversarial Erasin…		2020-11-09
ESPNet	ESPNet: Efficient Spatial Pyramid of Dilated Conv…		2018-03-19
FCN (VGG-16)	Fully Convolutional Networks for Semantic Segment…		2014-11-14
G2	Exploiting saliency for object segmentation from …		2017-01-28
CK	Simultaneous Detection and Segmentation		2014-07-07

PASCAL VOC 2012 test

Performance Over Time

Edit Benchmark Results

Edit Result

Top Performing Models

All Papers (51)