Open the spring-loaded cover
- Robot
- I2RT YAM, two-arm
- Trials
- 3
Lift the clear cover on the grey box all the way open, until it stays open on its own. It is spring-loaded and snaps shut if it is not pushed far enough.
Successful run · Gemini 4 ArgonSource ↗
RubricPass/fail
0The cover is closed.
1The cover is open and staying open on its own.
Full criteria and notes
- Full success check
- 1 if: The cover is open and staying open on its own. Else 0. two LLM judges (GPT-6 Astra, Claude Opus 5.5) on start/end photos must agree, else a person scores it.
- Trials
- 3 per model (27 counted over 9 models); avg@3.
Results on this task
ModelCoverCost / attemptTime / attempt
Gemini 4 Argon66.7$2.5634 min 42 s
Claude Opus 5.566.7$14.6412 min 42 s
GPT-6 Astra33.3$16.723 min 05 s
GPT-6.1 Sol33.3$13.253 min 28 s
GLM 5.3 Flash33.3$0.01320 min 48 s
Muse Wonder 1.00.00$1.658 min 56 s
Kimi K30.00$0.45816 min 29 s
Grok 4.70.00$0.6474 min 37 s
DeepSeek V4.1 Flash0.00$0.1297 min 22 s
DataCenterBench