Datasets / Physical AI

Robot Teleoperation Dataset

Custom collection · buyer-specified robots

Collect demonstrations on your robot platform, with synchronized observations, robot states, action trajectories, and embodiment documentation for policy training.

Dataset specification

  • Collected on demand on buyer-specified robot platforms and tasks
  • Reference rig: three synchronized stereo RGB streams at 1280×720 and 15 fps
  • Stereo-derived depth, with camera and sensor payload scoped per engagement
  • Robot states and actions at platform-native control rates
  • Robot platform, action-space convention, gripper encoding, and camera calibration documented
  • RLDS/TFRecord, LeRobot, HDF5, ROS bag, or a custom delivery schema

Intended uses

  • Imitation learning on a target robot platform
  • Vision-language-action policy training
  • Cross-embodiment training mixes with documented interfaces

Scope notes

  • This is custom collection; episode volume, platforms, tasks, and timing are scoped for each engagement.
  • The reference camera rig is configurable and is not a fixed requirement for every collection.
  • State and action rates depend on the selected robot platform.

Collection scope

Collection program

  • Custom collection on buyer-specified platforms and tasks
  • Episode volume scoped to buyer requirements

Reference capture rig

  • Three synchronized stereo RGB streams at 1280×720 and 15 fps
  • Stereo-derived depth; camera count, resolution, and sensor payload configurable per engagement

Robot interface

  • Robot states and actions at platform-native control rates
  • Documented action-space conventions, gripper encoding, and camera extrinsics

Delivery

  • Buyer-preferred schema, including Open X-Embodiment-compatible RLDS and LeRobot
  • HDF5, ROS bag, or a custom schema with JSON metadata

Annotation & metadata fields

  • Task and object labels
  • Task phases
  • Success and failure
  • Retry and recovery labels
  • Robot platform and action-space convention
  • Gripper encoding, camera extrinsics, and calibration

Capture methodology

  • Consented operators teleoperate the specified robot through task episodes
  • Multi-view stereo video, derived depth, robot states, and actions are recorded together
  • Camera and sensor configuration is agreed for each engagement
  • Full embodiment documentation accompanies the selected delivery

Provenance & rights chain

  • Recorded by consented participants or operators
  • Licensing and the selected delivery scope are reviewed with Datoric

Quality, duplicates & PII

How submissions are reviewed and cleaned before they are accepted into the dataset.

  • Timestamp and stream-alignment checks
  • Dropped-frame checks
  • State and action log completeness
  • Outcome review

Formats & delivery

  • Open X-Embodiment-compatible RLDS/TFRecord
  • LeRobot
  • HDF5 or ROS bag
  • Custom schema with JSON metadata and embodiment documentation

Rights & license scope

Licensed by Datoric for robotics training, with final scope governed by the agreement for the selected delivery.

Frequently asked

Is this a fixed inventory of robot episodes?
No. The current catalog offers custom collection on buyer-specified robot platforms and tasks. Episode volume and delivery timing are agreed for the engagement.
Can you deliver LeRobot or RLDS?
Yes. The catalog includes LeRobot and Open X-Embodiment-compatible RLDS/TFRecord, alongside HDF5, ROS bag, and custom schemas.
What embodiment information is included?
The delivery documents the robot platform, action-space convention, gripper encoding, camera extrinsics, and calibration so the recorded data can be interpreted correctly.

Related dataset specifications