Benchmarks/EFE-98/RB-Y1 · Navigate to

RB-Y1 · Navigate to

EFE-98MolmoSpaces
Robot
Rainbow RB-Y1
Trials
1
Time limit
1 h 00 min

Navigate to any tablelamp (2 available).

Official Embodied First Exam clip · 2.1× speedSource ↗
SuccessPass/fail

Judges your episode itself, on the state it ends in; it scores 1 if that state succeeds.. Your only budget is the time limit, from your start.

Full criteria and notes
Full success check
judges your episode itself, on the state it ends in; it scores 1 if that state succeeds.. Your only budget is the time limit (## Time limit), from your start (the service's time s and time left s count from your first request to it, so time left s never reaches 0 before your time is up: plan by it). Simulated time only advances with your commands (and get obs(seconds=...)).. Nothing to hand in: the service records the episode and grades it. Leave your script at /.. If the service crashes, a call fails with a connection error: it restarts and resumes the SAME episode (never a reset) in the state after the last call it completed. r.wait ready() waits for it; then check r.status().. Nothing is put into your context automatically: images come back as arrays in Python objects.
Scoring
A simulator error or a missing result counts as a fail.
Trials
1 graded attempt per test (standard mode: one live episode, no replay).

Task definition ↗ · All EFE-98 tasks