Benchmarks/Embodied First Exam/Outfit A Basic Toolbox

Outfit A Basic Toolbox

Embodied First ExamBEHAVIOR-1K
Robot
Galaxea R1 Pro
Trials
1
Time limit
1 h 51 min
Step limit
200,000

Pack the toolbox in the utility room. The drill, the pliers, the flashlight, the allen wrench and the screwdriver lie on the table there, next to the toolbox. Put all five tools inside the toolbox, keep the toolbox on the table, and close it.

Official Embodied First Exam clip · 3× speedSource ↗
SuccessPass/fail

Pass or fail: the simulator checks the goal described above.

Full criteria and notes
Full success check
Success means all of the following hold at the same time: the drill is inside the toolbox; the pliers are inside the toolbox; the flashlight is inside the toolbox; the allen wrench is inside the toolbox; the screwdriver is inside the toolbox; the toolbox is on top of the table; the toolbox is closed. How the simulator judges them: inside(A, B): the centre of A's axis-aligned bounding box lies within B's bounding box and within B's interior (container) volume. ontop(A, B): A touches B and B is directly below A (and not above it). open(A): at least one of A's openable joints (door, drawer, lid) is more than 5% of the way from closed to fully open; closed (not open) means every such joint is within 5% of closed. The service checks the goal; it counts once it has held for 1 s, released and at rest (Rules).
Scoring
A simulator error or a missing result counts as a fail.
Trials
1 graded attempt per test (standard mode: one live episode, no replay).

Task definition ↗ · All Embodied First Exam tasks