Benchmarks/MolmoSpaces/Pick with Affordance

Pick with Affordance

MolmoSpacesMolmoSpaces-Commonsense
Robot
Franka FR3
Trials
500
Time limit
20 s
Step limit
300

Pick up the <tool/object> by its semantically correct part.

No public clip for this task
SuccessPass/fail

Object lifted AND the current grasp classified as semantically correct. Mapping of site task to this class inferred from names.

Full criteria and notes
Full success check
Object lifted (PickTask success) AND the current grasp classified as semantically correct (SemanticGraspPickTask.judge success). Mapping of site task to this class inferred from names. Episode counts as success if this holds at any step (oracle success, the ranking metric); at-end success is also reported for some tasks. Benchmark: molmospaces-commonsense-bench; max steps 300; 500 episodes.
Scoring
1 per episode; task score = oracle successes / episodes x100.
Trials
500 episodes, each run once.

Task definition ↗ · All MolmoSpaces tasks