Benchmarks/Embodied First Exam/Carrying in Groceries

Carrying in Groceries

Embodied First ExamBEHAVIOR-1K
Robot
Galaxea R1 Pro
Trials
1
Time limit
1 h 51 min
Step limit
200,000

Bring the groceries in from the car. In the garage the car stands open with a sack inside it holding a beefsteak tomato and a carton of milk; put the tomato and the milk into a refrigerator in the kitchen, then close the car and the refrigerator.

Official Embodied First Exam clip · 3× speedSource ↗
SuccessPass/fail

Success means all of the following hold at the same time: the beefsteak tomato and the carton of milk are both inside one and the same refrigerator; the car is closed; the kitchen refrigerator is closed.

Full criteria and notes
Full success check
Success means all of the following hold at the same time: the beefsteak tomato and the carton of milk are both inside one and the same refrigerator; the car is closed; the kitchen refrigerator is closed (if the kitchen has several refrigerators, keep them all closed). How the simulator judges them: inside(A, B): the centre of A's axis-aligned bounding box lies within B's bounding box and within B's interior (container) volume. open(A): at least one of A's openable joints (door, drawer, lid) is more than 5% of the way from closed to fully open; closed (not open) means every such joint is within 5% of closed. The service checks the goal; it counts once it has held for 1 s, released and at rest (Rules).
Scoring
A simulator error or a missing result counts as a fail.
Trials
1 graded attempt per test (standard mode: one live episode, no replay).

Task definition ↗ · All Embodied First Exam tasks