Benchmarks/RoboLab-120/Cubes and blocks in bin

Cubes and blocks in bin

RoboLab-120Complex · Relational
Robot
Franka (DROID)
Trials
10
Time limit
4 min 00 s
Step limit
3,600

Put all the cubes and blocks in the bin.

Cubes and blocks in bin: task scene
Official scene renderSource ↗
SuccessPass/fail

Success when all of rubiks cube, rubiks cube, rubiks cube, yellow block, red block, green block, blue block inside grey bin and the gripper has released them.

Full criteria and notes
Full success check
Success when all of rubiks cube, rubiks cube, rubiks cube, yellow block, red block, green block, blue block inside grey bin (centroid inside the container's local bounding box with open-top slack) and the gripper has released them. Checked every step (episode ends at first success; 240 s horizon).
Instruction variants
Vague: Put blocks away. · Specific: Pick up every solid-colored cube and rubiks cubes from the table and place them all into the bin.
Scoring
Pass/fail, plus a subtask progress score from 0 to 1.
Trials
10 episodes per task.

Task definition ↗ · All RoboLab-120 tasks