Unplug the charger from the power strip
- Robot
- I2RT YAM, two-arm
- Trials
- 3
Unplug the white phone charger from the white power strip.
Successful run · Gemini 4 ArgonSource ↗
RubricPass/fail
0The charger is still in an outlet, even if loosened.
1The charger is completely out of the power strip, resting on the board or table.
Full criteria and notes
- Full success check
- 1 if: The charger is completely out of the power strip, resting on the board or table. Else 0. two LLM judges (GPT-6 Astra, Claude Opus 5.5) on start/end photos must agree, else a person scores it.
- Trials
- 3 per model (27 counted over 9 models); avg@3.
Results on this task
ModelUnplugCost / attemptTime / attempt
GPT-6 Astra100$7.251 min 39 s
GPT-6.1 Sol100$4.551 min 57 s
Muse Wonder 1.0100$0.9224 min 46 s
DeepSeek V4.1 Flash100$0.0944 min 31 s
Gemini 4 Argon66.7$1.1022 min 18 s
GLM 5.3 Flash66.7$0.01111 min 51 s
Claude Opus 5.533.3$11.2210 min 06 s
Kimi K333.3$0.47318 min 05 s
Grok 4.70.00$0.5734 min 53 s
DataCenterBench