Cap Pen
- Robot
- I2RT YAM, two-arm
- Trials
- 20
Pick up the pen and the pen cap, then put the cap on the pen.
Successful run · Claude Fable 5.2Source ↗
RubricStaged
0Neither pen nor cap picked up.
0.2Pen or cap picked up.
0.5Pen and cap both held off the surface simultaneously.
0.75Pen and cap touch while both are held in the air. No alignment requirement.
1Cap successfully placed onto the pen and remains attached at trial end.
Full criteria and notes
- Full success check
- 1.0 if: Cap successfully placed onto the pen and remains attached at trial end. Otherwise the highest qualifying lower level (judge picks exactly one level). Same levels as the Sept 23-24 blog rubric.
- Trials
- 20 per model configuration (120 per configuration over 6 tasks); graded by GPT-6 Astra video judge (robodojo_astra), human label on judge failure.
Results on this task
ModelCap PenCost / attemptTime / attempt
Claude Opus 5.549.3$2.583 min 17 s
Gemini 3.8 Flash47.3$0.5716 min 09 s
GPT-6.1 Sol47.0$2.314 min 30 s
GPT-6 Astra46.8$3.804 min 05 s
Gemini 4 Carbon46.0$2.8442 min 25 s
Claude Fable 5.245.5$7.805 min 39 s
GPT-6 Sol43.5$1.114 min 10 s
Gemini 4 Argon41.3$3.1325 min 06 s
GPT-5.6 Sol36.5$1.933 min 54 s
Dream-131.8——
MolmoAct210.0——
GR00T N1.710.0——
RoboDojo-RC