Benchmarks/RoboArena/Put the banana into the cup

Put the banana into the cup

RoboArena
Robot
Franka (DROID)
Trials
11
Time limit
27 s
Successful run · paligemma fast droid · 4× speedSource ↗
SuccessPreference

An evaluator runs two hidden policies from the same start and picks the better one, or a tie.

Full criteria and notes
Full success check
No rubric: evaluator-chosen task; evaluator runs two hidden policies from matched starts and states a preference A / B / tie (their own criterion). Only preferences enter the Bradley-Terry-Davidson ranking; evaluator progress score 0-100 is recorded but not used
Scoring
Pairwise preference A/B/tie; per-policy partial success 0-1 recorded, unused for rank.
Trials
11 session(s) (11 ranking-included); preferences A=7, B=4.

Task definition ↗ · All RoboArena tasks