Benchmarks/MolmoSpaces/Pick with Containment

Pick with Containment

MolmoSpacesMolmoSpaces-Commonsense
Robot
Franka FR3
Trials
500
Time limit
33 s
Step limit
500

Pick up the object from inside a container.

No public clip for this task
SuccessPass/fail

The simulator's success check passes at any step of the episode.

Full criteria and notes
Full success check
Object lifted >= succ pos threshold (0.01 m default; set per episode) above its start height while touching only robot bodies (PickTask.get info: only robot collision AND lift height >= threshold). (core PickTask with clutter.) Episode counts as success if this holds at any step (oracle success, the ranking metric); at-end success is also reported for some tasks. Benchmark: molmospaces-commonsense-bench; max steps 500.
Scoring
1 per episode; task score = oracle successes / episodes x100.
Trials
500 episodes, each run once.

Task definition ↗ · All MolmoSpaces tasks