Benchmarks/RoboLab-120/Bananas in bin three total

Bananas in bin three total

RoboLab-120Moderate · Relational and visual
Robot
Franka (DROID)
Trials
10
Time limit
60 s
Step limit
900

Make sure there are 3 (three) bananas in the grey bin.

Bananas in bin three total: task scene
Official scene renderSource ↗
SuccessPass/fail

Success when exactly 1 of banana, banana, banana inside grey bin and the gripper has released them.

Full criteria and notes
Full success check
Success when exactly 1 of banana, banana, banana inside grey bin (centroid inside the container's local bounding box with open-top slack) and the gripper has released them. Checked every step (episode ends at first success; 60 s horizon).
Instruction variants
Vague: 3 bananas in the bin. · Specific: In addition to bananas in the bin, add one more banana to the grey bin until there are exactly three bananas inside.
Scoring
Pass/fail, plus a subtask progress score from 0 to 1.
Trials
10 episodes per task.

Task definition ↗ · All RoboLab-120 tasks