Pen
- Robot
- Mobile manipulator
- Trials
- 20
- Time limit
- 50 s
- Step limit
- 3,000
Place the pens into the penholder.
Official EBench clip · 7.9× speedSource ↗
SuccessStaged
Reach the goal state, checked in simulation.
Full criteria and notes
- Full success check
- Ordered goal stages over sim state (checks: sr based genmanip relationship); a condition is met once it has held 50 consecutive sim steps (checked every 10); the next stage opens when every condition of one alternative set holds; episode score = mean over stages of (max over alternative sets of the weighted fraction of conditions met); success (SR) = score 1
- Scoring
- 1 stage(s), 20 instances; partial score from 0 to 1, success only at 1.
- Trials
- 20 Test-Mini instances, 1 episode each, step limit 3000 sim steps.
EBench