Sort Objects
- Robot
- I2RT YAM, two-arm
- Trials
- 20
Classify the two types of objects on the table and place them into the two baskets.
Successful run · Claude Fable 5.2 · 1.4× speedSource ↗
RubricPartial credit
0Both baskets score 0.
0.17Basket scores 0.17 + 0, in either order.
0.33Basket scores 0.33 + 0, in either order.
0.34Basket scores 0.17 + 0.17, for different categories.
0.5Basket scores 0.5 + 0, or 0.33 + 0.17, in either order.
0.66Basket scores 0.33 + 0.33, for different categories.
0.67Basket scores 0.5 + 0.17, in either order.
0.83Basket scores 0.5 + 0.33, in either order.
1Basket scores 0.5 + 0.5: all three objects of each category in separate pure baskets.
Full criteria and notes
- Full success check
- 1.0 if: Basket scores 0.5 + 0.5: all three objects of each category in separate pure baskets. Otherwise the highest qualifying lower level (judge picks exactly one level). Blog rubric gives per-basket scores 0/0.17/0.33/0.5 that are added; pinned revision lists the summed totals.
- Trials
- 20 per model configuration (120 per configuration over 6 tasks); graded by GPT-6 Astra video judge (robodojo_astra), human label on judge failure.
Results on this task
ModelSort ObjectsCost / attemptTime / attempt
Gemini 4 Carbon74.2$1.8228 min 13 s
Claude Fable 5.273.0$4.213 min 29 s
Gemini 4 Argon72.2$1.9915 min 53 s
Dream-160.8——
GPT-6 Astra46.6$3.654 min 26 s
GPT-6.1 Sol45.9$2.424 min 22 s
Gemini 3.8 Flash42.5$0.6937 min 25 s
Claude Opus 5.539.3$2.163 min 25 s
MolmoAct213.4——
GPT-6 Sol11.8$0.9243 min 58 s
GR00T N1.79.3——
GPT-5.6 Sol5.1$1.713 min 53 s
RoboDojo-RC