Block stack
- Robot
- SO-101
- Trials
- 30
- Typical time
- 22 s
Stack the colourful blocks on top of each other.
Successful run · pi0.5 · 1.2× speedSource ↗
SuccessOperator label
An operator labels each rollout successful, suboptimal or failed; only successful counts.
Full criteria and notes
- Full success check
- On-site operator labels each rollout: successful = goal achieved cleanly; suboptimal = goal achieved with poor-quality finish; failure = goal not achieved. Board counts strict success only (suboptimal = 0). No written per-task goal definition beyond the instruction; no fixed time limit in v0.1 (operator decides when to stop)
- Scoring
- 3-way label (successful / suboptimal / failure); strict success counts only successful; lenient rate also credits suboptimal.
- Trials
- 30 rollouts per policy (29 for one pi0 and one pi0.5 cell); 7 policies; per-policy strict success on this task 0-43% (Table 6).
ArmnetBench
π0.5
GR00T N1.7
MolmoAct2
SmolVLA
Diffusion Policy
ACT