Panoptic

CMU Panoptic Studio

Dataset Information
Modalities
Images
Introduced
2015
License
Custom (non-commercial)
Homepage
Official Website
Contents

Overview

CMU Panoptic is a large scale dataset providing 3D pose annotations (1.5 millions) for multiple people engaging social activities. It contains 65 videos (5.5 hours) with multi-view annotations, but only 17 of them are in multi-person scenario and have the camera parameters.

Massively Multiview System

  • 480 VGA camera views
  • 30+ HD views
  • 10 RGB-D sensors
  • Hardware-based sync
  • Calibration
  • Interesting Scenes with Labels

Multiple people

  • Socially interacting groups
  • 3D body pose
  • 3D facial landmarks
  • Transcripts + speaker ID

Hardware setup

  • 480 VGA cameras, 640 x 480 resolution, 25 fps, synchronized among themselves using a hardware clock
  • 31 HD cameras, 1920 x 1080 resolution, 30 fps, synchronized among themselves using a hardware clock, timing aligned with VGA cameras
  • 10 Kinect Ⅱ Sensors. 1920 x 1080 (RGB), 512 x 424 (depth), 30 fps, timing aligned among themselves and other sensors
    5 DLP Projectors. synchronized with HD cameras

Source: Single-Stage Multi-Person Pose Machines
Image Source: http://domedb.perception.cs.cmu.edu/

Variants: Panoptic

Associated Benchmarks

This dataset is used in 3 benchmarks:

Recent Benchmark Submissions

Task Model Paper Date
3D Multi-Person Pose Estimation RapidPoseTriangulation (without training) RapidPoseTriangulation: Multi-view Multi-person Whole-body Human … 2025-03-27
3D Multi-Person Pose Estimation IVT (f=5) IVT: An End-to-End Instance-guided Video … 2022-08-06
3D Multi-Person Pose Estimation Faster VoxelPose Faster VoxelPose: Real-time 3D Human … 2022-07-22
3D Multi-Person Pose Estimation GR-M3D Dynamic Graph Reasoning for Multi-person … 2022-07-22
3D Multi-Person Pose Estimation VirtualPose VirtualPose: Learning Generalizable 3D Human … 2022-07-20
3D Human Pose Estimation MUG MUG: Multi-human Graph Network for … 2022-05-25
3D Human Pose Estimation VTP VTP: Volumetric Transformer for Multi-view … 2022-05-25
3D Multi-Person Pose Estimation PIRN Permutation-Invariant Relational Network for Multi-person … 2022-04-11
3D Multi-Person Pose Estimation DAS Distribution-Aware Single-Stage Models for Multi-Person … 2022-03-15
3D Multi-Person Pose Estimation MvP Direct Multi-view Multi-person 3D Pose … 2021-11-07
3D Multi-Person Pose Estimation PRGN Graph-Based 3D Multi-Person Pose Estimation … 2021-09-13
3D Multi-Person Pose Estimation VoxelTrack VoxelTrack: Multi-Person 3D Human Pose … 2021-08-05
3D Multi-Person Pose Estimation BMP Body Meshes as Points 2021-05-06
3D Multi-Person Pose Estimation PlaneSweepPose Multi-View Multi-Person 3D Pose Estimation … 2021-04-06
3D Human Pose Estimation AdaFuse AdaFuse: Adaptive Multiview Fusion for … 2020-10-26
3D Human Pose Estimation ROMP (ResNet-50) Monocular, One-stage, Regression of Multiple … 2020-08-27
3D Multi-Person Pose Estimation SMAP SMAP: Single-Shot Multi-Person Absolute 3D … 2020-08-26
3D Multi-Person Pose Estimation HMOR HMOR: Hierarchical Multi-Person Ordinal Relations … 2020-08-01
3D Multi-Person Pose Estimation MVG Multi-person 3D Pose Estimation in … 2020-07-21
3D Multi-Person Pose Estimation VoxelPose VoxelPose: Towards Multi-Camera 3D Human … 2020-04-13

Research Papers

Recent papers with results on this dataset:

External Links: