Benchmarks/EBench

EBench

SimulationCode checkReleased Jun 2026Index weight 0.637
Shanghai AI Laboratory, Intern RoboticsMaintainer ↗

26 task types and 794 instances, ranked on a held-out test split.

As of November 17, 2026, Motubrain 2.0 leads with 73.5, followed by PICA-WAM (61.4) and OpenWAM-α (55.3). Official leaderboard ↗ · Paper ↗

Leaderboard

Tasks
26
Attempts / task
20
Median cost / task
$0.030
Median time / task
32 s

Held-out test split. Score gives partial credit.

Tasks

26 tasks. Hover a task to play its clip (26 of 26).

26 tasks · 26 with clips

Methodology

Scoring
Code check
Time cap / attempt
40 s
Control rate
60 Hz
Models in index
12 of 15

Scoring. Ordered state conditions in code; score is the share of stages met.

Who runs it. Shanghai AI Lab runs the simulator, the entrant runs the model.

Robots. Simulated arms in Isaac Sim (GenManip).

Note. The operator also makes InternW0-Δ and InternVLA. π0 and π0.5 are EBench fine-tunes.

Time per attempt. Not published. Estimated otherwise: time cap 40 s × (1 − success/2).

Cost per attempt. Not published. Estimated otherwise: GPT-6 Astra's median published cost per attempt on other boards; one H100 at $3.29 per hour (Lambda on-demand, Oct 2026) × time. GPU price source ↗