Benchmarks/Embodied First Exam/Clean Your Rusty Garden Tools

Clean Your Rusty Garden Tools

Embodied First ExamBEHAVIOR-1K
Robot
Galaxea R1 Pro
Trials
1
Time limit
1 h 51 min
Step limit
200,000

Clean the rusty garden tools. A rusty trowel and a rusty scraper lie on the driveway in the garden, next to a toolbox with steel wool inside; remove all the rust from both tools, put them inside the toolbox and close it.

Official Embodied First Exam clip · 3× speedSource ↗
SuccessPass/fail

Success means all of the following hold at the same time: no rust is left on the trowel or on the scraper; both tools are inside the toolbox; the toolbox is closed.

Full criteria and notes
Full success check
Success means all of the following hold at the same time: no rust is left on the trowel or on the scraper; both tools are inside the toolbox; the toolbox is closed. How the simulator judges them: inside(A, B): the centre of A's axis-aligned bounding box lies within B's bounding box and within B's interior (container) volume. open(A): at least one of A's openable joints (door, drawer, lid) is more than 5% of the way from closed to fully open; closed (not open) means every such joint is within 5% of closed. covered(A, S): at least one particle of the substance S (e.g. dust) is on A; A is clean of S (not covered) only when every particle of S has been removed from it. The service checks the goal; it counts once it has held for 1 s, released and at rest (Rules).
Scoring
A simulator error or a missing result counts as a fail.
Trials
1 graded attempt per test (standard mode: one live episode, no replay).

Task definition ↗ · All Embodied First Exam tasks