Benchmarks/RoboDojo-RC/Sort Objects

Sort Objects

RoboDojo-RCTier 1
Robot
I2RT YAM, two-arm
Trials
20

Classify the two types of objects on the table and place them into the two baskets.

Successful run · Claude Fable 5.2 · 1.4× speedSource ↗
RubricPartial credit
0Both baskets score 0.
0.17Basket scores 0.17 + 0, in either order.
0.33Basket scores 0.33 + 0, in either order.
0.34Basket scores 0.17 + 0.17, for different categories.
0.5Basket scores 0.5 + 0, or 0.33 + 0.17, in either order.
0.66Basket scores 0.33 + 0.33, for different categories.
0.67Basket scores 0.5 + 0.17, in either order.
0.83Basket scores 0.5 + 0.33, in either order.
1Basket scores 0.5 + 0.5: all three objects of each category in separate pure baskets.
Full criteria and notes
Full success check
1.0 if: Basket scores 0.5 + 0.5: all three objects of each category in separate pure baskets. Otherwise the highest qualifying lower level (judge picks exactly one level). Blog rubric gives per-basket scores 0/0.17/0.33/0.5 that are added; pinned revision lists the summed totals.
Trials
20 per model configuration (120 per configuration over 6 tasks); graded by GPT-6 Astra video judge (robodojo_astra), human label on judge failure.

Results on this task

Task definition ↗ · All RoboDojo-RC tasks