Benchmarks/Paper-reported/Living room scene1 put both the alphabet soup and the cream cheese box in the basket

Living room scene1 put both the alphabet soup and the cream cheese box in the basket

Paper-reportedLIBERO-Long (libero_10)
Robot
Franka Panda
Trials
50
Time limit
26 s
Step limit
520

Put both the alphabet soup and the cream cheese box in the basket.

Demo of this taskSource ↗
SuccessPass/fail

Goal state reached: alphabet soup in basket, cream cheese in basket.

Full criteria and notes
Full success check
All BDDL goal predicates true at some step within the horizon: alphabet_soup_1 in basket_1_contain_region (object body position inside the container region box; contact also required if the container is an object, not a site); cream_cheese_1 in basket_1_contain_region (object body position inside the container region box; contact also required if the container is an object, not a site). Goal: (And (In alphabet_soup_1 basket_1_contain_region) (In cream_cheese_1 basket_1_contain_region))
Scoring
Pass/fail; horizon 520 + 10 wait steps; suite success rate = mean over 10 tasks.
Trials
50 by convention (fixed init states); chosen by each paper.

Task definition ↗ · All Paper-reported tasks