Benchmarks/RoboLab-120/Clean up toys

Clean up toys

RoboLab-120Complex · Visual
Robot
Franka (DROID)
Trials
10
Time limit
5 min 00 s
Step limit
4,500

Clean up all the smaller toys and leave the birdhouse on the table.

Clean up toys: task scene
Official scene renderSource ↗
SuccessPass/fail

Success when all of rubiks cube, rubiks cube, rubiks cube, lizard figurine, yellow block, red block, green block, blue block, lizard figurine inside grey bin and the gripper has released them.

Full criteria and notes
Full success check
Success when all of rubiks cube, rubiks cube, rubiks cube, lizard figurine, yellow block, red block, green block, blue block, lizard figurine inside grey bin (centroid inside the container's local bounding box with open-top slack) and the gripper has released them. Checked every step (episode ends at first success; 300 s horizon).
Instruction variants
Vague: Clean up everything except the birdhouse. · Specific: Pick up every toy object (rubiks cube, lizard figurines, colored blocks) from the table and place them all into the bin. Please ignore the birdhouse and don't touch it.
Scoring
Pass/fail, plus a subtask progress score from 0 to 1.
Trials
10 episodes per task.

Task definition ↗ · All RoboLab-120 tasks