Benchmarks/VLA-Replica/Shake pepper n times

Shake pepper n times

VLA-ReplicaIn-distribution · Counting / Memory
Robot
SO-101
Trials
15
Time limit
1 min 30 s

Pour 1 shake of pepper into the red plate.

Official demo · 2.4× speedSource ↗
SuccessPass/fail

The exact number of pepper shakes is poured into the correct colored plate, the pepper is placed to the left of the plate, and SO-101 moved back to its home position.

Full criteria and notes
Instruction variants
Easy: Pour 1 shake of pepper into the red plate. · Easy: Pour 3 shakes of pepper into the red plate. · Medium: Pour 2 shakes of pepper into the red plate. · Medium: Pour 1 shake of pepper into the red plate. · Hard: Pour 3 shakes of pepper into the red plate.
Scoring
Pass/fail per trial, operator-judged, 90 s limit.

Results on this task

Task definition ↗ · All VLA-Replica tasks