Store In Safe
- Robot
- I2RT YAM, two-arm
- Trials
- 20
Place all the objects into the safe, then close the safe.
Successful run · Claude Fable 5.2 · 1.4× speedSource ↗
RubricStaged
0No objects inside the safe at trial end.
0.25One object inside the safe at trial end.
0.5Two objects inside the safe at trial end.
0.75Three objects inside the safe at trial end.
1Three objects inside the safe and the lid folded down over the opening at trial end, even if it rests on the contents or springs partly open when released.
Full criteria and notes
- Full success check
- 1.0 if: Three objects inside the safe and the lid folded down over the opening at trial end, even if it rests on the contents or springs partly open when released. Otherwise the highest qualifying lower level (judge picks exactly one level). Blog rubric (Sept 23-24 posts) top level reads "Three objects inside the safe and the lid closed at trial end"; pinned revision relaxes it to lid folded down.
- Trials
- 20 per model configuration (120 per configuration over 6 tasks); graded by GPT-6 Astra video judge (robodojo_astra), human label on judge failure.
Results on this task
ModelStore In SafeCost / attemptTime / attempt
Dream-170.0——
Claude Fable 5.270.0$4.483 min 41 s
Gemini 4 Argon55.0$2.8122 min 04 s
Gemini 4 Carbon52.5$2.2435 min 22 s
GPT-6 Astra41.3$3.313 min 37 s
GPT-6.1 Sol33.8$2.013 min 37 s
Claude Opus 5.531.3$2.063 min 02 s
Gemini 3.8 Flash26.3$0.6256 min 29 s
MolmoAct225.0——
GPT-5.6 Sol21.3$1.693 min 26 s
GR00T N1.721.3——
GPT-6 Sol17.5$0.8833 min 24 s
RoboDojo-RC