Benchmarks/Embodied First Exam/Clean Up Your Desk

Clean Up Your Desk

Embodied First ExamBEHAVIOR-1K
Robot
Galaxea R1 Pro
Trials
1
Time limit
1 h 51 min
Step limit
200,000

Clean up the desk in the child's room. A folder, a pencil, two pens, two paperback books and a pencil box lie on the desk; the other folder lies on the chair, the stapler is inside the bookcase, and the open laptop lies on the bed. Put both folders and both paperback books into the bookcase and the pencil and both pens into the pencil box, which stays on the desk; take the stapler out of the bookcase and put it on the desk; and put the laptop on the desk, closed.

Official Embodied First Exam clip · 3× speedSource ↗
SuccessPass/fail

Pass or fail: the simulator checks the goal described above.

Full criteria and notes
Full success check
Success means all of the following hold at the same time: both folders and both paperback books are inside the bookcase; the pencil and both pens are inside the pencil box; the pencil box, the stapler and the laptop are on top of the desk; the laptop is closed. How the simulator judges them: inside(A, B): the centre of A's axis-aligned bounding box lies within B's bounding box and within B's interior (container) volume. ontop(A, B): A touches B and B is directly below A (and not above it). open(A): at least one of A's openable joints (door, drawer, lid) is more than 5% of the way from closed to fully open; closed (not open) means every such joint is within 5% of closed. The service checks the goal; it counts once it has held for 1 s, released and at rest (Rules).
Scoring
A simulator error or a missing result counts as a fail.
Trials
1 graded attempt per test (standard mode: one live episode, no replay).

Task definition ↗ · All Embodied First Exam tasks