Close

MolmoSpacesMolmoSpaces v1
Robot
Franka FR3
Trials
1,000
Time limit
30 s
Step limit
450

Close the articulated object.

Close: task scene
Official MolmoSpaces clipSource ↗
SuccessPass/fail

The simulator's success check passes at any step of the episode.

Full criteria and notes
Full success check
1 - |q|/range of the target joint >= task success threshold (0.85 in base open task configs, i.e. at most ~15% open; per-episode JSON governs) (OpeningTask, task type='close'). Episode counts as success if this holds at any step (oracle success, the ranking metric); at-end success is also reported for some tasks. Benchmark: molmospaces-bench-v1/ithor/FrankaCloseDataGenConfig (20260123); horizon 450.
Scoring
1 per episode; task score = oracle successes / episodes x100.
Trials
~1,000 distinct episodes, each run once (median n=1000; varies by entry).

Results on this task

ModelClose
EchoPolicy-0 + Gemini-3.8-Flash91.3
Cosmic + Gemini-ER87.9
Awomo-0.5I87.2Awomo-0.5V86.0
ZoeInside-VLA85.7
CAPclose + Gemini-ER83.8
MagicBrain + Qwen3.7-Plus82.7
PrimeR081.3
PAT + Qwen3.8-27B81.3
Cosmos3-Nano-Policy79.1
WALL-OSS-0.578.5
PRTS-Droid76.3
MolmoAct271.3π0.565.1
PAT-RoboLab + Qwen3.8-27B63.0
Psi-R262.2
Vana-Policy60.8
π053.1
Phoenix + Gemini-ER50.0
LAP-VLA45.9
π0-FAST38.6

Task definition ↗ · All MolmoSpaces tasks