Benchmarks/MolmoSpaces/Pick-RandCam (MB-Pick-RandCam)

Pick-RandCam (MB-Pick-RandCam)

MolmoSpacesMolmoBot v1.5/v2
Robot
Franka FR3
Trials
1,000
Time limit
30 s

Pick up the object.

Official MolmoBot clip · 2.8× speedSource ↗
SuccessPass/fail

The simulator's success check passes at any step of the episode.

Full criteria and notes
Full success check
Object lifted >= succ pos threshold (0.01 m default; set per episode) above its start height while touching only robot bodies (PickTask.get info: only robot collision AND lift height >= threshold). Episode counts as success if this holds at any step (oracle success, the ranking metric); at-end success is also reported for some tasks. Benchmark: FrankaPickHardBench (20260206), filament, randomized exo camera (randomized_zed2_analogue_1 + wrist).
Scoring
1 per episode; task score = oracle successes / episodes x100.
Trials
~1,000 distinct episodes, each run once (median n=1000; varies by entry).

Task definition ↗ · All MolmoSpaces tasks