Benchmarks/RoboColiseum/Scoop popcorn

Scoop popcorn

RoboColiseumGeneral manipulation
Robot
AgiBot G2, two-arm
Trials
20
Time limit
37 s
Step limit
900

Scoop the popcorn with the right arm and pour it into the popcorn bucket.

Official demo · 2.5× speedSource ↗
SuccessStaged

Each checker below passes or fails in order; success needs all of them.

Full criteria and notes
Full success check
Single VLM checker (qwen3-vl-plus via auto score, every 30 steps, 900-step limit) judges 2 rubric points: at least one popcorn inside the bucket; 1 holds and no popcorn scattered on the table; step score = max satisfied/total seen (0, 0.5 or 1)
Scoring
1 VLM step scored 0 / 0.5 / 1 (2 rubric points); E2E=1 only at 1.0.
Trials
Local config: 20 cases, 20 instruction-episodes; Challenge count not published.

Task definition ↗ · All RoboColiseum tasks