Benchmarks/RoboLab-120/Bananas out of bin

Bananas out of bin

RoboLab-120Moderate · Relational and visual
Robot
Franka (DROID)
Trials
10
Time limit
1 min 30 s
Step limit
1,350

Take the bananas out.

Official RoboLab clip · 2× speedSource ↗
SuccessPass/fail

Success when all of banana and banana outside grey bin and the gripper has released them.

Full criteria and notes
Full success check
Success when all of banana and banana outside grey bin ( less than 50% of hull vertices inside) and the gripper has released them. Checked every step (episode ends at first success; 90 s horizon).
Instruction variants
Vague: Empty the grey bin. · Specific: Take all the bananas out of the grey bin and put it on the table.
Scoring
Pass/fail, plus a subtask progress score from 0 to 1.
Trials
10 episodes per task.

Task definition ↗ · All RoboLab-120 tasks