Benchmarks/ArmnetBench/Open lamp door

Open lamp door

ArmnetBenchTwo-arm cell
Robot
SO-101, two-arm
Trials
30
Typical time
22 s

Hold the lamp still with the left arm and open the door with the right gripper.

Successful run · Diffusion PolicySource ↗
SuccessOperator label

An operator labels each rollout successful, suboptimal or failed; only successful counts.

Full criteria and notes
Full success check
On-site operator labels each rollout: successful = goal achieved cleanly; suboptimal = goal achieved with poor-quality finish; failure = goal not achieved. Board counts strict success only (suboptimal = 0). No written per-task goal definition beyond the instruction; no fixed time limit in v0.1 (operator decides when to stop)
Scoring
3-way label (successful / suboptimal / failure); strict success counts only successful; lenient rate also credits suboptimal.
Trials
30 rollouts per policy (29 for one pi0 and one pi0.5 cell); 7 policies; per-policy strict success on this task 0-73% (Table 6).

Results on this task

Task definition ↗ · All ArmnetBench tasks