Before a robot can move anything, it has to understand the scene. A real table after dinner is not a tidy row of identical plates.
Recognising what can be handled, what should be left alone, and what needs a person’s help is the whole game.
Design notes