Benchmarks/RoboDojo-RC/Stand Up Bottles

Stand Up Bottles

RoboDojo-RCTier 1
Robot
I2RT YAM, two-arm
Trials
20

Stand all three bottles upright.

Successful run · Dream-1 · 8× speedSource ↗
RubricStaged
0No bottle gripped and lifted, tilted, or held upright.
0.1A bottle gripped and lifted clear of its supporting surface.
0.25A bottle tilted at least halfway upright or held upright at some point during the trial.
0.4One bottle standing (upright and released) at some point during the trial.
0.55One bottle standing and a second bottle tilted at least halfway upright or held upright at the same time.
0.7Two bottles standing simultaneously at some point during the trial.
0.85Two bottles standing and the third bottle tilted at least halfway upright or held upright at the same time.
1All three bottles standing at trial end.
Full criteria and notes
Full success check
1.0 if: All three bottles standing at trial end. Otherwise the highest qualifying lower level (judge picks exactly one level). Blog rubric (Sept 23-24 posts, revision label adapted-2026-09-22) has 5 levels 0/0.1/0.4/0.7/1; the pinned 8-level revision adds 0.25, 0.55, 0.85 and lets standing milestones count at any point.
Trials
20 per model configuration (120 per configuration over 6 tasks); graded by GPT-6 Astra video judge (robodojo_astra), human label on judge failure.

Results on this task

Task definition ↗ · All RoboDojo-RC tasks