ML Research Wiki / Benchmarks / 3D Hand Pose Estimation / HO-3D v2

HO-3D v2

3D Hand Pose Estimation Benchmark

Performance Over Time

📊 Showing 21 results | 📏 Metric: PA-MPJPE (mm)

Top Performing Models

Rank	Model	Paper	PA-MPJPE (mm)	Date	Code
1	Pose2Mesh	Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Pose	12.50	2020-08-20	📦 hongsukchoi/Pose2Mesh_RELEASE 📦 karanshahgithub/CS256-AI-Pose2Mesh
2	HOR	Towards unconstrained joint hand-object reconstruction from RGB videos	12.00	2021-08-16	📦 hassony2/homan
3	ArtiBoost	ArtiBoost: Boosting Articulated 3D Hand-Object Pose Estimation via Online Exploration and Synthesis	11.40	2021-09-12	📦 mvig-sjtu/artiboost 📦 lixiny/artiboost
4	S2Hand	Model-based 3D Hand Reconstruction via Self-Supervised Learning	11.40	2021-03-22	📦 TerenceCYJ/S2HAND
5	I2L-MeshNet	I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Image	11.20	2020-08-09	📦 mks0601/I2L-MeshNet_RELEASE
6	KPT-Transformer	Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimation	10.80	2021-04-29	📦 shreyashampali/kypt_transformer
7	Hampali et al.	HOnnotate: A method for 3D Annotation of Hand and Object Poses	10.70	2019-07-02	📦 shreyashampali/ho3d 📦 shreyashampali/HOnnotate 📦 rongakowang/densemutualattention 📦 anilarmagan/HANDS19-Challenge-Toolbox
8	METRO	End-to-End Human Pose and Mesh Reconstruction with Transformers	10.40	2020-12-17	📦 microsoft/MeshTransformer
9	DMA 📚	Interacting Hand-Object Pose Estimation via Dense Mutual Attention	10.10	2022-11-16	📦 rongakowang/densemutualattention
10	SHO	Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Time	10.10	2021-06-09	📦 stevenlsw/Semi-Hand-Object

All Papers (21)

Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Pose

2020

Pose2Mesh

hongsukchoi/Pose2Mesh_RELEASE karanshahgithub/CS256-AI-Pose2Mesh

Towards unconstrained joint hand-object reconstruction from RGB videos

2021

HOR

hassony2/homan

ArtiBoost: Boosting Articulated 3D Hand-Object Pose Estimation via Online Exploration and Synthesis

2021

ArtiBoost

mvig-sjtu/artiboost lixiny/artiboost

Model-based 3D Hand Reconstruction via Self-Supervised Learning

2021

S2Hand

TerenceCYJ/S2HAND

I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Image

2020

I2L-MeshNet

mks0601/I2L-MeshNet_RELEASE

Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimation

2021

KPT-Transformer

shreyashampali/kypt_transformer

HOnnotate: A method for 3D Annotation of Hand and Object Poses

2019

Hampali et al.

shreyashampali/ho3d shreyashampali/HOnnotate

End-to-End Human Pose and Mesh Reconstruction with Transformers

2020

METRO

microsoft/MeshTransformer

Interacting Hand-Object Pose Estimation via Dense Mutual Attention

2022

DMA

rongakowang/densemutualattention

Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Time

2021

SHO

stevenlsw/Semi-Hand-Object

I2UV-HandNet: Image-to-UV Prediction Network for Accurate and High-fidelity 3D Hand Mesh Modeling

2021

I2UV-HandNet

MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Image

2021

MobRecon

SeanChenxy/HandMesh

HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields

2024

HOISDF

amathislab/hoisdf

HandOccNet: Occlusion-Robust 3D Hand Mesh Estimation Network

2022

HandOccNet

3D Hand Reconstruction via Aggregating Intra and Inter Graphs Guided by Prior Knowledge for Hand-Object Interaction Scenario

2024

SemGCN

A Probabilistic Attention Model with Occlusion-aware Texture Regression for 3D Hand Reconstruction from a Single RGB Image

2023

AMVUR

zhehengjianglancaster/amvur

HandBooster: Boosting 3D Hand-Mesh Reconstruction by Conditional Synthesis and Sampling of Hand-Object Interactions

2024

HandBooster

hxwork/handbooster_pytorch

Reconstructing Hands in 3D with Transformers

2023

HaMeR

geopavlakos/hamer

Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mamba

2024

Hamba

humansensinglab/Hamba

WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wild

2024

WiLoR

rolpotamias/WiLoR

Collaborative Learning for Hand and Object Reconstruction with Attention-guided Graph Convolution

2022

Tse et al.

HO-3D v2

Performance Over Time

Edit Benchmark Results

Edit Result

Top Performing Models

All Papers (21)

Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Pose

Towards unconstrained joint hand-object reconstruction from RGB videos

ArtiBoost: Boosting Articulated 3D Hand-Object Pose Estimation via Online Exploration and Synthesis

Model-based 3D Hand Reconstruction via Self-Supervised Learning

I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Image

Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimation

HOnnotate: A method for 3D Annotation of Hand and Object Poses

End-to-End Human Pose and Mesh Reconstruction with Transformers

Interacting Hand-Object Pose Estimation via Dense Mutual Attention

Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Time

I2UV-HandNet: Image-to-UV Prediction Network for Accurate and High-fidelity 3D Hand Mesh Modeling

MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Image

HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields

HandOccNet: Occlusion-Robust 3D Hand Mesh Estimation Network

3D Hand Reconstruction via Aggregating Intra and Inter Graphs Guided by Prior Knowledge for Hand-Object Interaction Scenario

A Probabilistic Attention Model with Occlusion-aware Texture Regression for 3D Hand Reconstruction from a Single RGB Image

HandBooster: Boosting 3D Hand-Mesh Reconstruction by Conditional Synthesis and Sampling of Hand-Object Interactions

Reconstructing Hands in 3D with Transformers

Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mamba

WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wild

Collaborative Learning for Hand and Object Reconstruction with Attention-guided Graph Convolution

Model	Paper	PA-MPJPE (mm)	Date
Pose2Mesh	Pose2Mesh: Graph Convolutional Network for 3D Hum…	12.50	2020-08-20
HOR	Towards unconstrained joint hand-object reconstru…	12.00	2021-08-16
ArtiBoost	ArtiBoost: Boosting Articulated 3D Hand-Object Po…	11.40	2021-09-12
S2Hand	Model-based 3D Hand Reconstruction via Self-Super…	11.40	2021-03-22
I2L-MeshNet	I2L-MeshNet: Image-to-Lixel Prediction Network fo…	11.20	2020-08-09
KPT-Transformer	Keypoint Transformer: Solving Joint Identificatio…	10.80	2021-04-29
Hampali et al.	HOnnotate: A method for 3D Annotation of Hand and…	10.70	2019-07-02
METRO	End-to-End Human Pose and Mesh Reconstruction wit…	10.40	2020-12-17
DMA	Interacting Hand-Object Pose Estimation via Dense…	10.10	2022-11-16
SHO	Semi-Supervised 3D Hand-Object Poses Estimation w…	10.10	2021-06-09
I2UV-HandNet	I2UV-HandNet: Image-to-UV Prediction Network for …	9.90	2021-02-07
MobRecon	MobRecon: Mobile-Friendly Hand Mesh Reconstructio…	9.20	2021-12-06
HOISDF	HOISDF: Constraining 3D Hand-Object Pose Estimati…	9.20	2024-02-26
HandOccNet	HandOccNet: Occlusion-Robust 3D Hand Mesh Estimat…	9.10	2022-03-28
SemGCN	3D Hand Reconstruction via Aggregating Intra and …	8.80	2024-03-04
AMVUR	A Probabilistic Attention Model with Occlusion-aw…	8.30	2023-04-27
HandBooster	HandBooster: Boosting 3D Hand-Mesh Reconstruction…	8.20	2024-03-27
HaMeR	Reconstructing Hands in 3D with Transformers	7.70	2023-12-08
Hamba	Hamba: Single-view 3D Hand Reconstruction with Gr…	7.50	2024-07-12
WiLoR	WiLoR: End-to-end 3D Hand Localization and Recons…	7.50	2024-09-18
Tse et al.	Collaborative Learning for Hand and Object Recons…	0.49	2022-04-27