Datasets / Physical AI

Multimodal Human Manipulation Dataset

6,000 hours · multi-sensor · mocap + RGB-D

6,000-hour sensor-rich human manipulation dataset with egocentric video, external cameras, RGB-D, motion capture, IMU signals, hand pose, object labels, task phases, and interaction annotations.

What's included

  • Synchronized egocentric and external video
  • RGB-D and depth
  • Motion capture
  • IMU signals
  • Hand pose
  • Body pose
  • Object and tool labels
  • Action segments
  • Hand-object contact labels
  • Task phases
  • Completion states
  • Calibration checks
  • Sensor alignment QA
View on Hugging Face