Benchmarks/Poke & Wiggle/Open the toolbox with a screwdriver

Open the toolbox with a screwdriver

Poke & WiggleTool use
Robot
Franka FR3 Duo, two-arm
Trials
540
Time limit
1 min 30 s
Run · RhoSource ↗
StepsHuman rating

Both latches open, Screwdriver on the table, Lid fully open. People rate the episode; Ok or Excellent counts.

1Push the toolbox, without grasping it, to the center of the workspace.
2Pick up the screwdriver.
3Reorient the screwdriver in the gripper.
4Release the first toolbox latch with the screwdriver.
5Release the second toolbox latch with the screwdriver.
6Place the screwdriver on the table.
7Pick up the toolbox handle.
8Lift up the toolbox lid with the left arm.
9Put the toolbox lid down with the right arm.
Full criteria and notes
Full success check
Success when people rate the episode Ok or Excellent: Both latches open; Screwdriver on the table; Lid fully open. Constraints: Toolbox pushed to the center without grasping it; Latches opened using the screwdriver.
Trials
540 rated episodes per robot model (30 per training tier and placement group) and 90 per coding agent.

Task definition ↗ · All Poke & Wiggle tasks