Benchmarks/RoboArena/Cover the controller with the towel

Cover the controller with the towel

RoboArena
Robot
Franka (DROID)
Trials
15
Time limit
27 s
Successful run · Apricot · 4× speedSource ↗
SuccessPreference

An evaluator runs two hidden policies from the same start and picks the better one, or a tie.

Full criteria and notes
Full success check
No rubric: evaluator-chosen task; evaluator runs two hidden policies from matched starts and states a preference A / B / tie (their own criterion). Only preferences enter the Bradley-Terry-Davidson ranking; evaluator progress score 0-100 is recorded but not used
Scoring
Pairwise preference A/B/tie; per-policy partial success 0-1 recorded, unused for rank.
Trials
15 session(s) (15 ranking-included); preferences A=8, B=5, TIE=2.

Task definition ↗ · All RoboArena tasks