Benchmarks/MolmoSpaces/Pick with Occlusion

Pick with Occlusion

MolmoSpacesMolmoSpaces-Commonsense
Robot
Franka FR3
Trials
1,000
Time limit
20 s
Step limit
300

Pick up the object, which is partly hidden behind clutter.

No public clip for this task
SuccessPass/fail

The simulator's success check passes at any step of the episode.

Full criteria and notes
Full success check
Object lifted >= succ pos threshold (0.01 m default; set per episode) above its start height while touching only robot bodies (PickTask.get info: only robot collision AND lift height >= threshold). (core PickTask with clutter stored in each episode.) Episode counts as success if this holds at any step (oracle success, the ranking metric); at-end success is also reported for some tasks. Benchmark: molmospaces-commonsense-bench; max steps 300 (CSV headers).
Scoring
1 per episode; task score = oracle successes / episodes x100.
Trials
~1,000 distinct episodes, each run once (median n=1000; varies by entry).

Task definition ↗ · All MolmoSpaces tasks