Enter a code on the keypad
- Robot
- I2RT YAM, two-arm
- Trials
- 3
Type 52 on the number pad and nothing else. The iPhone next to it shows what you type.

Scene stillSource ↗
RubricPartial credit
0The display shows anything else, or nothing.
0.5The display is one keypress away from 52: one character missing, one extra, or one wrong.
1The display reads exactly 52.
Full criteria and notes
- Full success check
- 1 if: The display reads exactly 52. 0.5 if: The display is one keypress away from 52: one character missing, one extra, or one wrong. Else 0. scored from the keypad display key log (judges cross-check).
- Trials
- 3 per model (27 counted over 9 models); avg@3.
Results on this task
ModelKeypadCost / attemptTime / attempt
GPT-6 Astra33.3$17.943 min 15 s
GPT-6.1 Sol0.00$9.443 min 18 s
Gemini 4 Argon0.00$2.3238 min 08 s
Claude Opus 5.50.00$27.2622 min 01 s
Muse Wonder 1.00.00$2.0611 min 28 s
GLM 5.3 Flash0.00$0.01724 min 36 s
Kimi K30.00$0.89428 min 39 s
Grok 4.70.00$0.6014 min 44 s
DeepSeek V4.1 Flash0.00$0.1868 min 25 s
DataCenterBench