Robot recognizing vowels in a multimodal way

Paul Valentin (1) , Sofiane Boucenna (1) , Philippe Gaussier (1) , Alexandre Pitti (1)

1 ETIS - UMR 8051 - Equipes Traitement de l'Information et Systèmes

This paper presents a sensory-motor architecture based on a neural network allowing a robot to recognize vowels in a multi-modal way thanks to human mimicking. The robot autonomously learns to associate its internal state to a human's vowel as an infant would to recognize vowel, and learn to associate congruent information.

Mots clés: intermodality; Neural network; sound; vision; robotics; social interaction

Domaines: Intelligence artificielle [cs.AI]; Apprentissage [cs.LG]; Réseau de neurones [cs.NE]; Robotique [cs.RO]

Paul Valentin, Sofiane Boucenna, Philippe Gaussier, Alexandre Pitti. Robot recognizing vowels in a multimodal way. 2019 Joint IEEE 9th International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), Aug 2019, Oslo, Norway. pp.103-104. ⟨hal-02295330⟩