Benchmarks/RoboLab-120/Dishes in bin

Dishes in bin

RoboLab-120Moderate · Visual
Robot
Franka (DROID)
Trials
10
Time limit
3 min 00 s
Step limit
2,700

Put the dishware in the grey bin.

Dishes in bin: task scene
Official scene renderSource ↗
SuccessPass/fail

Success when all of mug, mug, bowl inside grey bin and the gripper has released them.

Full criteria and notes
Full success check
Success when all of mug, mug, bowl inside grey bin (centroid inside the container's local bounding box with open-top slack) and the gripper has released them. Checked every step (episode ends at first success; 180 s horizon).
Instruction variants
Vague: Put away dishes. · Specific: Pick up the two mugs and a bowl from the table and place them into the grey bin.
Scoring
Pass/fail, plus a subtask progress score from 0 to 1.
Trials
10 episodes per task.

Task definition ↗ · All RoboLab-120 tasks