Move the slider to the other line
- Robot
- I2RT YAM, two-arm
- Trials
- 3
Move the small slider on the white dimmer from the black line it is on to the other black line.
Successful run · GPT-6.1 SolSource ↗
RubricPartial credit
0The slider did not move toward the other line, or the large rocker switch was changed.
0.5The slider moved noticeably toward the other line but stopped short of it.
1The slider reached the other black line (at it or past it).
Full criteria and notes
- Full success check
- 1 if: The slider reached the other black line (at it or past it). 0.5 if: The slider moved noticeably toward the other line but stopped short of it. Else 0. two LLM judges (GPT-6 Astra, Claude Opus 5.5) on start/end photos must agree, else a person scores it.
- Trials
- 3 per model (27 counted over 9 models); avg@3.
Results on this task
ModelSliderCost / attemptTime / attempt
GPT-6.1 Sol33.3$15.653 min 43 s
Kimi K333.3$0.46116 min 32 s
GPT-6 Astra16.7$25.564 min 44 s
Gemini 4 Argon16.7$2.1638 min 50 s
Claude Opus 5.50.00$20.7517 min 14 s
Muse Wonder 1.00.00$1.557 min 17 s
GLM 5.3 Flash0.00$0.01819 min 07 s
Grok 4.70.00$0.6255 min 25 s
DeepSeek V4.1 Flash0.00$0.1396 min 56 s
DataCenterBench