Benchmarks/RoboLab-120/Black items in bin

Black items in bin

RoboLab-120Complex · Visual
Robot
Franka (DROID)
Trials
10
Time limit
2 min 00 s
Step limit
1,800

Put the black items in the grey bin.

Black items in bin: task scene
Official scene renderSource ↗
SuccessPass/fail

Success when all of keyboard, remote control, computer mouse, smartphone, glasses inside grey bin and the gripper has released them.

Full criteria and notes
Full success check
Success when all of keyboard, remote control, computer mouse, smartphone, glasses inside grey bin (centroid inside the container's local bounding box with open-top slack) and the gripper has released them. Checked every step (episode ends at first success; 120 s horizon).
Instruction variants
Vague: Clean up the dark items. · Specific: Identify all black-colored objects on the table and place them into the grey bin.
Scoring
Pass/fail, plus a subtask progress score from 0 to 1.
Trials
10 episodes per task.

Task definition ↗ · All RoboLab-120 tasks