Benchmarks/MolmoSpaces/Pick with Covering

Pick with Covering

MolmoSpacesMolmoSpaces-Commonsense
Robot
Franka FR3
Trials
1,000
Time limit
20 s
Step limit
300

Pick up the object, which is covered by another object.

No public clip for this task
SuccessPass/fail

The simulator's success check passes at any step of the episode.

Full criteria and notes
Full success check
Object lifted >= succ pos threshold (0.01 m default; set per episode) above its start height while touching only robot bodies (PickTask.get info: only robot collision AND lift height >= threshold). (core PickTask with clutter.) Episode counts as success if this holds at any step (oracle success, the ranking metric); at-end success is also reported for some tasks. Benchmark: molmospaces-commonsense-bench; max steps 300.
Scoring
1 per episode; task score = oracle successes / episodes x100.
Trials
~1,000 distinct episodes, each run once (median n=1000; varies by entry).

Task definition ↗ · All MolmoSpaces tasks