Benchmarks/Paper-reported/Pick up the black bowl between the plate and the ramekin and place it on the plate
Pick up the black bowl between the plate and the ramekin and place it on the plate
- Robot
- Franka Panda
- Trials
- 50
- Time limit
- 11 s
- Step limit
- 220
Pick the akita black bowl between the plate and the ramekin and place it on the plate.
Demo of this taskSource ↗
SuccessPass/fail
Goal state reached: akita black bowl on plate.
Full criteria and notes
- Full success check
- All BDDL goal predicates true at some step within the horizon: akita_black_bowl_1 on plate_1 (in contact, not below it, xy centres within 3 cm). Goal: (And (On akita_black_bowl_1 plate_1))
- Scoring
- Pass/fail; horizon 220 + 10 wait steps; suite success rate = mean over 10 tasks.
- Trials
- 50 by convention (fixed init states); chosen by each paper.
Paper-reported
π0.5
X-VLA
GR00T N1.7
OpenVLA-OFT
CogACT
UniVLA
RIPT-VLA
SmolVLA
Diffusion Policy