Benchmarks/EBench/Frame against pen holder

Frame against pen holder

EBenchTabletop precision · short horizon
Robot
Fixed arm
Trials
20
Time limit
38 s
Step limit
2,300

Place the picture frame upright on the table so that its back rests against the cup.

Official EBench clip · 8× speedSource ↗
SuccessStaged

Reach 2 goal stages in order, checked in simulation; success needs all 2.

Full criteria and notes
Full success check
Ordered goal stages over sim state (checks: frame against pen holder:check holder posture, frame against pen holder:is near, frame against pen holder:is pick up); a condition is met once it has held 100 consecutive sim steps (checked every 10); the next stage opens when every condition of one alternative set holds; episode score = mean over stages of (max over alternative sets of the weighted fraction of conditions met); success (SR) = score 1
Scoring
2 stage(s), 20 instances; partial score from 0 to 1, success only at 1.
Trials
20 Test-Mini instances, 1 episode each, step limit 2300 sim steps.

Task definition ↗ · All EBench tasks