Benchmarks/RoboChallenge/Scoop with a small spoon

Scoop with a small spoon

RoboChallengeTable30 v2
Robot
ALOHA, two-arm
Trials
10
Typical time
5 min 46 s

Scoop beans and place them into the empty bowl.

Official demo · 5.3× speedSource ↗
RubricPartial credit

A tester awards the stage points below, out of 10.

2Hold the bowl of beans steady with one gripper.
3Scoop up the beans successfully with the spoon.
3Pour the beans into the empty bowl.
2Return the spoon to its original position.
Full criteria and notes
Full success check
On-site tester awards the listed stage points per rollout (max 10); rollout halted at a task-specific timeout and scored on progress so far; success = all critical stages completed (critical flags not published per task)

Graded example

Scoop with a small spoon · Qwen-RobotManip, 10 rollouts

Task reference frame (ALOHA).
Rollout12345678910
Points / 1021081052102210

Rubric: hold bowl 2 · scoop 3 · pour 3 · return spoon 2.

Run score 61 / 100; 4 of 10 rollouts complete. Three stopped after holding the bowl, one after scooping, one after pouring.

Task definition ↗ · All RoboChallenge tasks