Benchmarks/Paper-reported/Living room scene2 put both the alphabet soup and the tomato sauce in the basket

Living room scene2 put both the alphabet soup and the tomato sauce in the basket

Paper-reportedLIBERO-Long (libero_10)
Robot
Franka Panda
Trials
50
Time limit
26 s
Step limit
520

Put both the alphabet soup and the tomato sauce in the basket.

Demo of this taskSource ↗
SuccessPass/fail

Goal state reached: alphabet soup in basket, tomato sauce in basket.

Full criteria and notes
Full success check
All BDDL goal predicates true at some step within the horizon: alphabet_soup_1 in basket_1_contain_region (object body position inside the container region box; contact also required if the container is an object, not a site); tomato_sauce_1 in basket_1_contain_region (object body position inside the container region box; contact also required if the container is an object, not a site). Goal: (And (In alphabet_soup_1 basket_1_contain_region) (In tomato_sauce_1 basket_1_contain_region))
Scoring
Pass/fail; horizon 520 + 10 wait steps; suite success rate = mean over 10 tasks.
Trials
50 by convention (fixed init states); chosen by each paper.

Task definition ↗ · All Paper-reported tasks