Benchmarks/EBench/Utensils to holder

Utensils to holder

EBenchMobile manipulation · short horizon
Robot
Mobile manipulator
Trials
20
Time limit
17 s
Step limit
1,000

Pick up the fork and spoon from the countertop and place them into the utensil holder.

Official EBench clip · 4.7× speedSource ↗
SuccessStaged

Reach the goal state, checked in simulation.

Full criteria and notes
Full success check
Ordered goal stages over sim state (checks: sr based genmanip relationship); a condition is met once it has held 50 consecutive sim steps (checked every 10); the next stage opens when every condition of one alternative set holds; episode score = mean over stages of (max over alternative sets of the weighted fraction of conditions met); success (SR) = score 1
Scoring
1 stage(s), 20 instances; partial score from 0 to 1, success only at 1.
Trials
20 Test-Mini instances, 1 episode each, step limit 1000 sim steps.

Task definition ↗ · All EBench tasks