Turn the knob to the mark
- Robot
- I2RT YAM, two-arm
- Trials
- 3
Turn the round knob on the white box clockwise until the black line on it points at the black mark on the box.
Successful run · Gemini 4 ArgonSource ↗
RubricPartial credit
0The knob did not turn clockwise (unchanged, or turned the other way).
0.5The knob turned clockwise noticeably but the line stops short of the goal mark.
1The line on the knob points at the goal mark (turned clockwise to it).
Full criteria and notes
- Full success check
- 1 if: The line on the knob points at the goal mark (turned clockwise to it). 0.5 if: The knob turned clockwise noticeably but the line stops short of the goal mark. Else 0. two LLM judges (GPT-6 Astra, Claude Opus 5.5) on start/end photos must agree, else a person scores it.
- Trials
- 3 per model (27 counted over 9 models); avg@3.
Results on this task
ModelKnobCost / attemptTime / attempt
Gemini 4 Argon100$1.6529 min 04 s
GPT-6 Astra83.3$20.513 min 43 s
GPT-6.1 Sol83.3$8.622 min 33 s
Claude Opus 5.550.0$21.4217 min 31 s
Kimi K350.0$0.80526 min 53 s
Muse Wonder 1.033.3$1.519 min 15 s
Grok 4.733.3$0.5634 min 51 s
GLM 5.3 Flash16.7$0.00909 min 37 s
DeepSeek V4.1 Flash16.7$0.1005 min 08 s
DataCenterBench