Training Data for Robotics

Demonstration capture, specified to a brief, for bimanual imitation learning, dexterous manipulation and vision-language-action policies.

What FourthHuman does

What a brief captures

A capture specification pairs first-person video with the telemetry a policy needs — IMU streams and a 3D camera trajectory — and every clip is annotated against the open FH-Ego v1 schema. Nothing here is stock: the brief defines the task, the environment and the rig before anything is recorded.

How provenance works

Every clip carries a SHA-256 consent receipt in a hash-chained, DPDP-aligned ledger, so a buyer re-verifies one clip instead of trusting a badge. Automated face redaction (YuNet) runs server-side at ingestion, before any human review, and fails closed — it refuses to emit a clip rather than emit one un-redacted. Licence plates are not covered. We hold no third-party attestation — no SOC 2, no ISO 27001.

What a brief costs to scope

Scoping is a conversation, not a price list: environment, session length, sensor rig and annotation tier each move the number. Capture Partners are paid transparently at a published band — ₹250–400/hr of accepted capture, by UPI on QA approval, no agent in the middle and no deduction. Those are the terms partners will be paid on, not a payout rail already running: the Capture Partner network is in pilot build-out and no payment provider is integrated.

Delivery formats, and what we do not offer

Simulators leave a sim-to-real gap, and static web video carries no spatial depth, no IMU and no camera calibration — which is why a robotics brief starts from purpose-built capture rather than a scrape. A brief names its own environment, domestic through industrial to healthcare, and its own rig, from gaze-oriented wearables to global-shutter stereo head rigs.

Every format below is verified by an automated export bench before we quote it. MCAP and WebDataset are not on offer — MCAP is a robotics logging container rather than a training format, and labs shard WebDataset internally. We would rather tell you which is which.

Export formats — status stated in words, never by colour alone
FormatStatusWhat consumes it
LeRobot v2.1StandardLoads in pi0 / openpi and GR00T pipelines. Observations only — retargeting to an action space is your step
HDF5 — EgoDex-style paired .hdf5 + .mp4StandardALOHA and RoboMimic imitation-learning frameworks
FH-Ego v1 JSONStandardOur open schema — the full annotation layer, readable without our tooling
Zarr v2On requestChunked-array training pipelines
TFRecord — RLDS-styleOn requestJAX pipelines. Not tfds.load-compatible without a dataset builder, and we say so up front
MCAPNot offeredROS 2 logging and replay, not policy training
WebDatasetNot offeredLabs shard this internally

Commission a brief

Tell us the task, the environment and the policy you are training, and we scope a capture brief against it. Stated plainly: we are pre-revenue with no customers, one validated end-to-end annotation run, and a Capture Partner network in pilot build-out. The catalogue lists capture specifications you can commission, with target volumes and their real availability status.

If you are training a manipulation or imitation-learning policy, the useful first question is not how many hours you need — it is which task, in which environment, on which rig. That is what a brief pins down.