Benchmarks/MolmoSpaces/Pick.5 (MB-Pick-MSProc)

Pick.5 (MB-Pick-MSProc)

MolmoSpacesMolmoBot v1.5/v2
Robot
Franka FR3
Trials
1,000
Time limit
30 s

Pick up the object.

Official MolmoBot clip · 2.8× speedSource ↗
SuccessPass/fail

The simulator's success check passes at any step of the episode.

Full criteria and notes
Full success check
Object lifted >= succ pos threshold (0.01 m default; set per episode) above its start height while touching only robot bodies (PickTask.get info: only robot collision AND lift height >= threshold). Episode counts as success if this holds at any step (oracle success, the ranking metric); at-end success is also reported for some tasks. Benchmark: molmospaces-bench-v2/procthor-10k/FrankaPickDroidMiniBench (20251231), classic renderer; horizon from episode specs.
Scoring
1 per episode; task score = oracle successes / episodes x100.
Trials
~1,000 distinct episodes, each run once (median n=1000; varies by entry).

Task definition ↗ · All MolmoSpaces tasks