Benchmarks/RoboArena/Close the book

Close the book

RoboArena
Robot
Franka (DROID)
Trials
35
Time limit
27 s

Close the book [2 spelling/case variants].

Successful run · paligemma fast specialist droid · 4× speedSource ↗
SuccessPreference

An evaluator runs two hidden policies from the same start and picks the better one, or a tie.

Full criteria and notes
Full success check
No rubric: evaluator-chosen task; evaluator runs two hidden policies from matched starts and states a preference A / B / tie (their own criterion). Only preferences enter the Bradley-Terry-Davidson ranking; evaluator progress score 0-100 is recorded but not used
Scoring
Pairwise preference A/B/tie; per-policy partial success 0-1 recorded, unused for rank.
Trials
35 session(s) (35 ranking-included); preferences A=19, B=12, TIE=4.

Task definition ↗ · All RoboArena tasks