Benchmarks/RoboDojo-RC/Store In Safe

Store In Safe

RoboDojo-RCTier 1
Robot
I2RT YAM, two-arm
Trials
20

Place all the objects into the safe, then close the safe.

Successful run · Claude Fable 5.2 · 1.4× speedSource ↗
RubricStaged
0No objects inside the safe at trial end.
0.25One object inside the safe at trial end.
0.5Two objects inside the safe at trial end.
0.75Three objects inside the safe at trial end.
1Three objects inside the safe and the lid folded down over the opening at trial end, even if it rests on the contents or springs partly open when released.
Full criteria and notes
Full success check
1.0 if: Three objects inside the safe and the lid folded down over the opening at trial end, even if it rests on the contents or springs partly open when released. Otherwise the highest qualifying lower level (judge picks exactly one level). Blog rubric (Sept 23-24 posts) top level reads "Three objects inside the safe and the lid closed at trial end"; pinned revision relaxes it to lid folded down.
Trials
20 per model configuration (120 per configuration over 6 tasks); graded by GPT-6 Astra video judge (robodojo_astra), human label on judge failure.

Results on this task

Task definition ↗ · All RoboDojo-RC tasks