Benchmarks/EBench/Teacup to saucer teapot to tray

Teacup to saucer teapot to tray

EBenchMobile manipulation · short horizon
Robot
Mobile manipulator
Trials
20
Time limit
17 s
Step limit
1,000

Pick up the teacup on the desk and place it into the empty saucer. Then pick up the teapot and place it into the tray.

Official EBench clip · 4.9× speedSource ↗
SuccessStaged

Reach the goal state, checked in simulation.

Full criteria and notes
Full success check
Ordered goal stages over sim state (checks: sr based genmanip relationship); a condition is met once it has held 50 consecutive sim steps (checked every 10); the next stage opens when every condition of one alternative set holds; episode score = mean over stages of (max over alternative sets of the weighted fraction of conditions met); success (SR) = score 1
Scoring
1 stage(s), 20 instances; partial score from 0 to 1, success only at 1.
Trials
20 Test-Mini instances, 1 episode each, step limit 1000 sim steps.

Task definition ↗ · All EBench tasks