Tool insert

ArmnetBenchOne-arm cell
Robot
SO-101
Trials
30
Typical time
24 s

Insert the missing tool into the empty slot on the toolbox.

Successful run · pi0.5 · 1.5× speedSource ↗
SuccessOperator label

An operator labels each rollout successful, suboptimal or failed; only successful counts.

Full criteria and notes
Full success check
On-site operator labels each rollout: successful = goal achieved cleanly; suboptimal = goal achieved with poor-quality finish; failure = goal not achieved. Board counts strict success only (suboptimal = 0). No written per-task goal definition beyond the instruction; no fixed time limit in v0.1 (operator decides when to stop)
Scoring
3-way label (successful / suboptimal / failure); strict success counts only successful; lenient rate also credits suboptimal.
Trials
30 rollouts per policy (29 for one pi0 and one pi0.5 cell); 7 policies; per-policy strict success on this task 3-53% (Table 6).

Results on this task

Task definition ↗ · All ArmnetBench tasks