Benchmarks/Embodied First Exam/Organizing Art Supplies

Organizing Art Supplies

Embodied First ExamBEHAVIOR-1K
Robot
Galaxea R1 Pro
Trials
1
Time limit
1 h 51 min
Step limit
200,000

In the bedroom, pack the art supplies lying on the desk (a glue stick, a rubber eraser, a paintbrush and a marker) into the carryall, which stands on the floor, and put the carryall on the desk.

Official Embodied First Exam clip · 3× speedSource ↗
SuccessPass/fail

Success means all of the following hold at the same time: the glue stick, the rubber eraser, the paintbrush and the marker are each inside the carryall; the carryall is on top of the desk.

Full criteria and notes
Full success check
Success means all of the following hold at the same time: the glue stick, the rubber eraser, the paintbrush and the marker are each inside the carryall; the carryall is on top of the desk. How the simulator judges them: inside(A, B): the centre of A's axis-aligned bounding box lies within B's bounding box and within B's interior (container) volume. ontop(A, B): A touches B and B is directly below A (and not above it). The service checks the goal; it counts once it has held for 1 s, released and at rest (Rules).
Scoring
A simulator error or a missing result counts as a fail.
Trials
1 graded attempt per test (standard mode: one live episode, no replay).

Task definition ↗ · All Embodied First Exam tasks