Benchmarks

Updated November 17, 202623 benchmarks21,778 tasks

Explore the 23 benchmarks behind the index and every task they test.

RoboDojo teamSimulation
RoboDojo Sim
Released Jul 2026 · 37 models
42 tasks · Staged rubric
Generalization (standard and randomized scenes), Precision, Long-horizon, Memory, Open-ended (unseen task specs). 42 tasks.
1SOLVE79.5
2Q0-Preview74.2
3Claude Fable 5.264.9
RoboDojo teamReal robots
RoboDojo Real
Released Jul 2026 · 14 models
18 tasks · Staged rubric
6 tasks on each of 3 robots, 18 in all. Scored per robot.
1SLA-Preview42.3
2InternW0-Δ38.9
3OpenWAM-α37.6
Robocurve, Inc.Real robots
RoboDojo-RC
Released Sep 2026 · 12 models
6 tasks · Staged rubric
6 RoboDojo tasks adapted, Cap Pen, Pack and Pour Fruit, Sort Objects, Stack Bowls, Stand Up Bottles, Store In Safe.
1Dream-159.3
2Claude Fable 5.257.3
3Gemini 4 Carbon54.5
Artificial AnalysisReal robots
AA-Robotics
Released Oct 2026 · 5 models
8 tasks · Pass/fail + partial
8 tasks, press a button, place a toy, pour a drink, tidy blocks, match shapes, write hello world, build a tower and measure a box.
1GPT-6.2 Astra79.0
2GPT-6.2 Sol78.0
3Claude Fable 5.275.0
RoboChallengeReal robots
RoboChallenge
Released Oct 2025 · 14 models
60 tasks · Staged rubric
30 household tabletop tasks, grouped here by robot. Progress score and success rate.
1Era076.3
2DM072.3
3GigaBrain-0.168.3
RoboArena teamReal robots
RoboArena
Released Jun 2025 · 6 models
2,752 tasks · Pairwise preference
Open-ended tasks chosen by evaluators, mostly pick and place. Ranked by pairwise preference.
1Spirit v1.61788
2DreamZero1735
3Apricot1661
NVIDIA Seattle Robotics LabSimulation
RoboLab-120
Released Apr 2026 · 13 models
120 tasks · Code check
120 tasks. Difficulty (simple, moderate, complex) and skill (visual, relational, procedural), plus reworded instructions.
1AMP186.0
2SenseNova-RoboRSI57.1
3Lakeside51.0
Ai2Simulation
MolmoSpaces
Released Feb 2026 · 8 models
19 tasks · Code check
Pick, pick and place, open, close, randomized camera and commonsense tasks.
1MagicBrain + Qwen3.7-Plus94.4
2MolmoBot-Img92.8
3MolmoBot92.0
RoboTwin teamSimulation
RoboTwin 2.0
Released Jun 2025 · 22 models
50 tasks · Code check
50 two-arm tasks, each in a clean and a randomized setting.
1CloudRobo-WM89.0
2Awomo-0.686.5
3GO-3 Nano Preview85.0
RoboCasa teamSimulation
RoboCasa365
Released Mar 2026 · 12 models
50 tasks · Code check
Atomic tasks (seen), multi-step tasks (seen) and multi-step tasks (unseen).
1HexaShell85.6
2Awomo-0.5I64.4
3minionx62.6
Positronic RoboticsReal robots
PhAIL
Released Mar 2026 · 7 models
410 tasks · Generic ladder
Two benchmarks. 286 everyday DROID tasks, and bin-to-bin pick and place of four household objects timed against a human teleoperator.
1Cosmos3-Nano-Policy68.1
2π0.562.4
3GR00T N1.762.3
Poke & Wiggle GmbHReal robots
Poke & Wiggle
Released Sep 2026 · 11 models
10 tasks · Human rating
10 tasks in basic skills, high precision, two-arm handling and tool use, from sorting screws to plugging a DC jack and opening a toolbox with a screwdriver. Each on training, unseen in-between and unseen outside placements.
1Claude Fable 5.265.0
2Gemini 4 Carbon45.0
3Claude Opus 5.539.0
Robocurve, Inc.Real robots
DataCenterBench
Released Oct 2026 · 9 models
10 tasks · Staged rubric
10 single steps from data-center manuals, controls (knob, key, switch, cover, slider, keypad) and connectors (plug, unplug, Ethernet, cable clip).
1GPT-6 Astra40.0
2GPT-6.1 Sol38.3
3Gemini 4 Argon35.0
ArmnetReal robots
ArmnetBench
Released Jul 2026 · 7 models
12 tasks · Operator label
12 tasks, 8 one-arm and 4 two-arm, from block stacking to cable clips and towel folding.
1π0.547.6
2π035.1
3GR00T N1.729.4
Intelligent Robotics and Vision LabReal robots
VLA-Replica
Released May 2026 · 7 models
18 tasks · Pass/fail
10 tasks in pick and place, object interaction and counting, plus an out-of-distribution track.
1π0.553.0
2GR00T N1.742.0
3MolmoAct239.0
RoboColosseum teamReal robots
RoboColosseum Open
Released Nov 2026 · 8 models
7,137 tasks · Progress + preference
Fresh instructions written on the spot at each site, in offices, homes, parks and factories.
1GPT-6 Astra1925
2MolmoAct21869
3GalaxeaVLA G0.51744
RoboColosseum teamReal robots
RoboColosseum FT
Released Nov 2026 · 5 models
20 tasks · Staged rubric
20 tasks, five per robot, from stacking and drawers to towel folding and loading a washing machine.
1π0.573.1
2MolmoAct260.5
3GR00T N1.755.0
Shanghai AI Laboratory, Intern RoboticsSimulation
EBench
Released Jun 2026 · 12 models
26 tasks · Code check
26 task types and 794 instances, ranked on a held-out test split.
1Motubrain 2.073.5
2PICA-WAM61.4
3OpenWAM-α55.3
RoboColiseum consortiumSimulation
RoboColiseum
Released Aug 2026 · 19 models
38 tasks · Code check
38 tasks in four groups, instruction following, spatial reasoning, robustness and general manipulation.
1MXI SimWorld v0 Preview96.6
2HexaShell96.5
3FF Omnimind94.5
LIBERO-Pro TeamSimulation
LIBERO-Pro2
Released Oct 2026 · 14 models
339 tasks · Code check
Standard LIBERO plus static and live perturbations to observation, execution, conditions, robot, language and environment.
1CloudRobo-WM 1.099.6
2Lingbot-VA98.5
3Fast-WAM97.8
LIBERO-Plus authorsSimulation
LIBERO-Plus
Released Oct 2025 · 8 models
10,030 tasks · Code check
Seven perturbations, camera, robot start, language, lighting, background, sensor noise and layout.
1OpenVLA-OFT+79.6
2OpenVLA-OFT69.6
3RIPT-VLA68.4
Embodied First Exam teamSimulation
Embodied First Exam
Released Oct 2026 · 10 models
498 tasks · Code check
Standard, real-time and privileged modes. Coding agents only.
1Claude Fable 5.249.6
2GPT-6 Astra34.4
3GPT-6.1 Sol32.2
Ai2Simulation
Paper-reported
Released 2021 to 2024 · 13 models
105 tasks · Code check
LIBERO's four suites (spatial, object, goal, long), SimplerEnv robots, CALVIN multi-step chains.
1X-VLA98.1
2OpenVLA-OFT97.1
3GR00T N1.797.0