ML Research Wiki / Benchmarks / 3D Hand Pose Estimation / FreiHAND

FreiHAND

3D Hand Pose Estimation Benchmark

Performance Over Time

📊 Showing 30 results | 📏 Metric: PA-MPJPE

Top Performing Models

Rank	Model	Paper	PA-MPJPE	Date	Code
1	DetNet	Monocular Real-time Full Body Capture with Inter-part Correlations	15.70	2020-12-11	-
2	Hasson et al.	Learning joint reconstruction of hands and manipulated objects	13.20	2019-04-11	📦 hassony2/manopth 📦 hassony2/obman_train 📦 hassony2/obman
3	Boukhayma et al.	3D Hand Shape and Pose from Images in the Wild	13.00	2019-02-09	📦 yihui-he/epipolar-transformers 📦 boukhayma/3dhand
4	PIXIE hand expert	Collaborative Regression of Expressive Bodies using Moderation	12.10	2021-05-11	📦 YadiraF/PIXIE
5	ExPose (hand sub-network h)	Monocular Expressive Body Regression through Body-Driven Attention	11.80	2020-08-20	📦 vchoutas/expose
6	MANO CNN	FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images	10.90	2019-09-10	-
7	Zimmermann et al.	FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images	10.70	2019-09-10	-
8	YoutubeHand	Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wild	8.60	2020-04-04	📦 674106399/JointBoneLoss 📦 EAST-J/Youtubehand 📦 pwc-1/Paper-9 📦 nanzhaogang/contrib
9	Pose2Mesh	Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Pose	7.80	2020-08-20	📦 hongsukchoi/Pose2Mesh_RELEASE 📦 karanshahgithub/CS256-AI-Pose2Mesh
10	Hand4Whole	Accurate 3D Hand Pose Estimation for Whole-Body 3D Human Mesh Estimation	7.70	2020-11-23	📦 mks0601/Hand4Whole_RELEASE

All Papers (30)

Monocular Real-time Full Body Capture with Inter-part Correlations

2020

DetNet

Learning joint reconstruction of hands and manipulated objects

2019

Hasson et al.

hassony2/manopth hassony2/obman_train hassony2/obman

3D Hand Shape and Pose from Images in the Wild

2019

Boukhayma et al.

yihui-he/epipolar-transformers boukhayma/3dhand

Collaborative Regression of Expressive Bodies using Moderation

2021

PIXIE hand expert

YadiraF/PIXIE

Monocular Expressive Body Regression through Body-Driven Attention

2020

ExPose (hand sub-network h)

vchoutas/expose

FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images

2019

MANO CNN

FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images

2019

Zimmermann et al.

Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wild

2020

YoutubeHand

674106399/JointBoneLoss EAST-J/Youtubehand

Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Pose

2020

Pose2Mesh

hongsukchoi/Pose2Mesh_RELEASE karanshahgithub/CS256-AI-Pose2Mesh

Accurate 3D Hand Pose Estimation for Whole-Body 3D Human Mesh Estimation

2020

Hand4Whole

mks0601/Hand4Whole_RELEASE

I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Image

2020

I2L-MeshNet

mks0601/I2L-MeshNet_RELEASE

Hand Image Understanding via Deep Multi-Task Learning

2021

HIU-DMTL

MandyMo/HIU-DMTL

Cross-Attention of Disentangled Modalities for 3D Human Mesh Recovery with Transformers

2022

FastMETRO

postech-ami/fastmetro

Camera-Space Hand Mesh Recovery via Semantic Aggregation and Adaptive 2D-1D Registration

2021

CMR

SeanChenxy/HandMesh

I2UV-HandNet: Image-to-UV Prediction Network for Accurate and High-fidelity 3D Hand Mesh Modeling

2021

I2UV-HandNet

FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterization

2023

FastViT-MA36

rwightman/pytorch-image-models apple/ml-fastvit

Towards Accurate Alignment in Real-time 3D Hand-Mesh Reconstruction

2021

Tang et al.

Sampling is Matter: Point-guided 3D Human Mesh Reconstruction

2023

PointHMR

DCVL-3D/PointHMR_release

PeCLR: Self-Supervised 3D Hand Pose Estimation from monocular RGB via Equivariant Contrastive Learning

2021

PeCLR

dahiyaaneesh/peclr ut-vision/simhand

End-to-End Human Pose and Mesh Reconstruction with Transformers

2020

METRO

microsoft/MeshTransformer

A Probabilistic Attention Model with Occlusion-aware Texture Regression for 3D Hand Reconstruction from a Single RGB Image

2023

AMVUR

zhehengjianglancaster/amvur

A Simple Baseline for Efficient Hand Mesh Reconstruction

2024

Zhou et al.

patiencefromzhou/simplehand

Mesh Graphormer

2021

MeshGraphormer

microsoft/meshgraphormer 2024-MindSpore-1/Code2 MS-P3/code5

MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Image

2021

MobRecon

SeanChenxy/HandMesh

HHMR: Holistic Hand Mesh Recovery by Enhancing the Multimodal Controllability of Graph Diffusion Models

2024

HHMR

Reconstructing Hands in 3D with Transformers

2023

HaMeR

geopavlakos/hamer

MMHMR: Generative Masked Modeling for Hand Mesh Recovery

2024

MaskHand

HandOS: 3D Hand Reconstruction in One Stage

2024

HandOS

Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mamba

2024

Hamba

humansensinglab/Hamba

WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wild

2024

WiLoR

rolpotamias/WiLoR

Model	Paper	PA-MPJPE	Date
DetNet	Monocular Real-time Full Body Capture with Inter-…	15.70	2020-12-11
Hasson et al.	Learning joint reconstruction of hands and manipu…	13.20	2019-04-11
Boukhayma et al.	3D Hand Shape and Pose from Images in the Wild	13.00	2019-02-09
PIXIE hand expert	Collaborative Regression of Expressive Bodies usi…	12.10	2021-05-11
ExPose (hand sub-network h)	Monocular Expressive Body Regression through Body…	11.80	2020-08-20
MANO CNN	FreiHAND: A Dataset for Markerless Capture of Han…	10.90	2019-09-10
Zimmermann et al.	FreiHAND: A Dataset for Markerless Capture of Han…	10.70	2019-09-10
YoutubeHand	Weakly-Supervised Mesh-Convolutional Hand Reconst…	8.60	2020-04-04
Pose2Mesh	Pose2Mesh: Graph Convolutional Network for 3D Hum…	7.80	2020-08-20
Hand4Whole	Accurate 3D Hand Pose Estimation for Whole-Body 3…	7.70	2020-11-23
I2L-MeshNet	I2L-MeshNet: Image-to-Lixel Prediction Network fo…	7.60	2020-08-09
HIU-DMTL	Hand Image Understanding via Deep Multi-Task Lear…	7.30	2021-07-24
FastMETRO	Cross-Attention of Disentangled Modalities for 3D…	7.10	2022-07-27
CMR	Camera-Space Hand Mesh Recovery via Semantic Aggr…	7.00	2021-03-04
I2UV-HandNet	I2UV-HandNet: Image-to-UV Prediction Network for …	6.90	2021-02-07
FastViT-MA36	FastViT: A Fast Hybrid Vision Transformer using S…	6.70	2023-03-24
Tang et al.	Towards Accurate Alignment in Real-time 3D Hand-M…	6.70	2021-09-03
PointHMR	Sampling is Matter: Point-guided 3D Human Mesh Re…	6.60	2023-04-19
PeCLR	PeCLR: Self-Supervised 3D Hand Pose Estimation fr…	6.60	2021-06-10
METRO	End-to-End Human Pose and Mesh Reconstruction wit…	6.30	2020-12-17
AMVUR	A Probabilistic Attention Model with Occlusion-aw…	6.10	2023-04-27
Zhou et al.	A Simple Baseline for Efficient Hand Mesh Reconst…	6.00	2024-03-04
MeshGraphormer	Mesh Graphormer	6.00	2021-04-01
MobRecon	MobRecon: Mobile-Friendly Hand Mesh Reconstructio…	5.80	2021-12-06
HHMR	HHMR: Holistic Hand Mesh Recovery by Enhancing th…	5.80	2024-06-03
HaMeR	Reconstructing Hands in 3D with Transformers	5.70	2023-12-08
MaskHand	MMHMR: Generative Masked Modeling for Hand Mesh R…	5.40	2024-12-18
HandOS	HandOS: 3D Hand Reconstruction in One Stage	5.30	2024-12-02
Hamba	Hamba: Single-view 3D Hand Reconstruction with Gr…	5.30	2024-07-12
WiLoR	WiLoR: End-to-end 3D Hand Localization and Recons…	5.10	2024-09-18

FreiHAND

Performance Over Time

Edit Benchmark Results

Edit Result

Top Performing Models

All Papers (30)

Monocular Real-time Full Body Capture with Inter-part Correlations

Learning joint reconstruction of hands and manipulated objects

3D Hand Shape and Pose from Images in the Wild

Collaborative Regression of Expressive Bodies using Moderation

Monocular Expressive Body Regression through Body-Driven Attention

FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images

FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images

Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wild

Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Pose

Accurate 3D Hand Pose Estimation for Whole-Body 3D Human Mesh Estimation

I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Image

Hand Image Understanding via Deep Multi-Task Learning

Cross-Attention of Disentangled Modalities for 3D Human Mesh Recovery with Transformers

Camera-Space Hand Mesh Recovery via Semantic Aggregation and Adaptive 2D-1D Registration

I2UV-HandNet: Image-to-UV Prediction Network for Accurate and High-fidelity 3D Hand Mesh Modeling

FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterization

Towards Accurate Alignment in Real-time 3D Hand-Mesh Reconstruction

Sampling is Matter: Point-guided 3D Human Mesh Reconstruction

PeCLR: Self-Supervised 3D Hand Pose Estimation from monocular RGB via Equivariant Contrastive Learning

End-to-End Human Pose and Mesh Reconstruction with Transformers

A Probabilistic Attention Model with Occlusion-aware Texture Regression for 3D Hand Reconstruction from a Single RGB Image

A Simple Baseline for Efficient Hand Mesh Reconstruction

Mesh Graphormer

MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Image

HHMR: Holistic Hand Mesh Recovery by Enhancing the Multimodal Controllability of Graph Diffusion Models

Reconstructing Hands in 3D with Transformers

MMHMR: Generative Masked Modeling for Hand Mesh Recovery

HandOS: 3D Hand Reconstruction in One Stage

Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mamba

WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wild