Benchmarks/RoboLab-120/Blocks in bin

Blocks in bin

RoboLab-120Complex
Robot
Franka (DROID)
Trials
10
Time limit
2 min 30 s
Step limit
2,250

Sort all colored blocks into the bin.

Blocks in bin: task scene
Official scene renderSource ↗
SuccessPass/fail

Success when all of yellow block, red block, green block, blue block inside grey bin and the gripper has released them.

Full criteria and notes
Full success check
Success when all of yellow block, red block, green block, blue block inside grey bin (centroid inside the container's local bounding box with open-top slack) and the gripper has released them. Checked every step (episode ends at first success; 150 s horizon).
Instruction variants
Vague: Put away the colored blocks. · Specific: Put away the solidly-colored wooden blocks from the table and place them all into the bin.
Scoring
Pass/fail, plus a subtask progress score from 0 to 1.
Trials
10 episodes per task.

Task definition ↗ · All RoboLab-120 tasks