RoboColosseum Open
RoboColosseum teamMaintainer ↗Fresh instructions written on the spot at each site, in offices, homes, parks and factories.
As of November 17, 2026, GPT-6 Astra leads with 1925, followed by MolmoAct2 (1869) and GalaxeaVLA G0.5 (1744). Official leaderboard ↗ · Paper ↗
Leaderboard
- Tasks
- 7,137
- Attempts / task
- —
- Median cost / task
- $0.036
- Median time / task
- 40 s
Difficulty-calibrated rating on an Elo-style scale, fitted separately for each robot, so compare within a column only.
GPT-6 Astra192516081448$17.74est.40 sest.2
MolmoAct2186915721052$0.036est.40 sest.3
GalaxeaVLA G0.5174415771213$0.036est.40 sest.4
Claude Opus 5.5163620811917$6.17est.40 sest.5
GR00T N1.713507201324$0.036est.40 sest.6
π0.5128513101712$0.036est.40 sest.7
LingBot-VLA v212331533—$0.036est.40 sest.8
Grok 4.711608791000$0.596est.40 sest.Tasks
7,137 evaluator-written instructions; the 30 most-run shown.






























Methodology
- Scoring
- Progress + preference
- Time cap / attempt
- 53 s
- Control rate
- 15 Hz
- Models in index
- 8 of 9
Scoring. Evaluators write the task, score each blinded run 0–100 and pick A, B or tie.
Who runs it. Operator network at 124 everyday sites; blinded evaluators pick the better of two unnamed runs.
Robots. Franka (DROID setup), two-arm YAM, SO-101.
Note. Rated per robot from task success, adjusted for task difficulty; robots are never compared with each other. MolmoAct2's authors help run it. Not the same benchmark as RoboColiseum.
Time per attempt. Not published. Estimated otherwise: time cap 53 s × (1 − success/2).
Cost per attempt. Not published. Estimated otherwise: GPT-6 Astra's median published cost per attempt on other boards; Claude Opus 5.5's median published cost per attempt on other boards; one H100 at $3.29 per hour (Lambda on-demand, Oct 2026) × time; Grok 4.7's median published cost per attempt on other boards. GPU price source ↗