Abstract

A vital component of intelligent action is affordance detection: understanding what actions external objects afford the viewer. This requires the agent to understand the physical nature of the object being viewed, its own physical nature, and the potential relationships possible when they interact. Although robotics researchers have investigated affordance detection, the way in which the morphology of the robot facilitates, obstructs, or otherwise influences the robot's ability to detect affordances has yet to be studied. We do so here and find that a robot with an appropriate morphology can evolve to predict whether it will fit through an aperture with just minimal tactile feedback. We also find that robots with more complex morphologies evolve more accurate affordance detection than those with simpler morphologies if both have the same evolutionary optimization budget. This work demonstrates that sensation, thought, and action are necessary but not sufficient for understanding how affordance detection may evolve in organisms or robots: morphology must also be taken into account. It also suggests that, in the future, we may optimize morphology along with control in order to facilitate affordance detection in robots, and thus improve their reliable and safe action in the world.

Federico Pigozzi, Stephanie Woodman, Eric Medvet, Rebecca Kramer-Bottiglio, Josh Bongard | Apr 12, 2023 | GECCO 2023

Morphology choice affects the evolution of affordance detection in robots.

This is the Supplementary Material page with videos of our experimental results. Please see the paper for details. Code is also available.

1) Affordance detection of an effective morphology, impassable environment

2) Affordance detection of an effective morphology, impassable environment

3) Affordance detection of an effective morphology, passable environment

4) Affordance detection of an ineffective morphology, impassable environment