Benchmarks/RoboArena/Close the drawer

Close the drawer

RoboArenaOpen / Close
Robot
Franka (DROID)
Trials
28
Time limit
27 s

Close the drawer [3 spelling/case variants].

Successful run · pi0 fast droid · 4× speedSource ↗
SuccessPreference

An evaluator runs two hidden policies from the same start and picks the better one, or a tie.

Full criteria and notes
Full success check
No rubric: evaluator-chosen task; evaluator runs two hidden policies from matched starts and states a preference A / B / tie (their own criterion). Only preferences enter the Bradley-Terry-Davidson ranking; evaluator progress score 0-100 is recorded but not used
Scoring
Pairwise preference A/B/tie; per-policy partial success 0-1 recorded, unused for rank.
Trials
28 session(s) (28 ranking-included); preferences B=13, A=10, TIE=5.

Task definition ↗ · All RoboArena tasks