Benchmarks/LIBERO-Pro2

LIBERO-Pro2

SimulationCode checkReleased Oct 2026Index weight 0.85
LIBERO-Pro TeamMaintainer ↗

Standard LIBERO plus static and live perturbations to observation, execution, conditions, robot, language and environment.

As of November 17, 2026, CloudRobo-WM 1.0 leads with 99.6, followed by Lingbot-VA (98.5) and Fast-WAM (97.8). Official leaderboard ↗ · Paper ↗

Leaderboard

Tasks
339
Attempts / task
30
Median cost / task
$0.010
Median time / task
11 s

Success rate (%). Category columns are the static perturbations.

#Model
1CloudRobo-WM 1.099.677.886.060.7$0.0089est.9.7 sest.
2Lingbot-VANot counted in the index98.568.781.835.7——
3Fast-WAM97.855.970.15.2$0.010est.11 sest.
4Cosmos PolicyNot counted in the index97.570.872.270.8——
5MolmoAct297.271.276.965.1$0.0095est.10 sest.6OpenVLA-OFT97.158.964.646.3$0.010est.11 sest.7X-VLA95.061.266.049.3$0.010est.11 sest.8π0.593.366.773.843.3$0.0098est.11 sest.
9OpenVLA-OFT_mNot counted in the index92.559.364.349.7——
10OpenVLA-OFT+Not counted in the index92.159.263.845.0——
11UniVLA92.152.961.058.1$0.011est.12 sest.
12Anchor-AlignNot counted in the index91.355.961.638.6——
13GR00T N1.790.460.063.948.5$0.010est.11 sest.
14OpenVLA-OFT_wNot counted in the index89.253.861.967.6——
15RIPT-VLA87.954.860.142.8$0.011est.12 sest.16π0-FAST80.453.255.939.9$0.011est.12 sest.17WorldVLA70.039.837.831.1$0.012est.13 sest.18OpenVLA64.633.936.434.4$0.012est.14 sest.19π063.838.635.360.0$0.012est.13 sest.20NORA51.321.523.519.4$0.013est.15 sest.

Tasks

339 tasks. Hover a task to play its clip (339 of 339).

339 tasks · 339 with clips

Methodology

Scoring
Code check
Time cap / attempt
17 s
Control rate
20 Hz
Models in index
14 of 20

Scoring. BDDL goal predicates checked in the simulator, pass/fail.

Who runs it. One team re-ran official checkpoints.

Robots. Simulated Franka.

Time per attempt. Not published. Estimated otherwise: time cap 16 s × (1 − success/2).

Cost per attempt. Not published. Estimated otherwise: one H100 at $3.29 per hour (Lambda on-demand, Oct 2026) × time. GPU price source ↗