Put the cap back on the spray bottle
- Robot
- Franka (DROID)
- Trials
- 10
- Time limit
- 27 s
Best attempt · pi0 fast droid · 4× speedSource ↗
SuccessPreference
An evaluator runs two hidden policies from the same start and picks the better one, or a tie.
Full criteria and notes
- Full success check
- No rubric: evaluator-chosen task; evaluator runs two hidden policies from matched starts and states a preference A / B / tie (their own criterion). Only preferences enter the Bradley-Terry-Davidson ranking; evaluator progress score 0-100 is recorded but not used
- Scoring
- Pairwise preference A/B/tie; per-policy partial success 0-1 recorded, unused for rank.
- Trials
- 10 session(s) (10 ranking-included); preferences B=5, A=5.
RoboArena