TUHH Open Research
Help
  • Log In
    New user? Click here to register.Have you forgotten your password?
  • English
  • Deutsch
  • Communities & Collections
  • Publications
  • Research Data
  • People
  • Institutions
  • Projects
  • Statistics
  1. Home
  2. TUHH
  3. Publication References
  4. The Embodied Crossmodal Self Forms Language and Interaction: A Computational Cognitive Review
 
Options

The Embodied Crossmodal Self Forms Language and Interaction: A Computational Cognitive Review

Publikationstyp
Journal Article
Date Issued
2021-08-16
Sprache
English
Author(s)
Röder, Frank  
Özdemir, Ozan  
Nguyen, Phuong D. H.  
Wermter, Stefan  
Eppe, Manfred  
TORE-URI
http://hdl.handle.net/11420/12062
Journal
Frontiers in psychology  
Volume
12
Article Number
716671
Citation
Frontiers in Psychology 12 : 716671 (2021-08-16)
Publisher DOI
10.3389/fpsyg.2021.716671
Scopus ID
2-s2.0-85114290309
Human language is inherently embodied and grounded in sensorimotor representations of the self and the world around it. This suggests that the body schema and ideomotor action-effect associations play an important role in language understanding, language generation, and verbal/physical interaction with others. There are computational models that focus purely on non-verbal interaction between humans and robots, and there are computational models for dialog systems that focus only on verbal interaction. However, there is a lack of research that integrates these approaches. We hypothesize that the development of computational models of the self is very appropriate for considering joint verbal and physical interaction. Therefore, they provide the substantial potential to foster the psychological and cognitive understanding of language grounding, and they have significant potential to improve human-robot interaction methods and applications. This review is a first step toward developing models of the self that integrate verbal and non-verbal communication. To this end, we first analyze the relevant findings and mechanisms for language grounding in the psychological and cognitive literature on ideomotor theory. Second, we identify the existing computational methods that implement physical decision-making and verbal interaction. As a result, we outline how the current computational methods can be used to create advanced computational interaction models that integrate language grounding with body schemas and self-representations.
Subjects
developmental psychology
developmental robotics
dialog
embodiment cognition
grounding language
minimal self
reinforcement learning
MLE@TUHH
TUHH
Weiterführende Links
  • Contact
  • Send Feedback
  • Cookie settings
  • Privacy policy
  • Impress
DSpace Software

Built with DSpace-CRIS software - Extension maintained and optimized by 4Science
Design by effective webwork GmbH

  • Deutsche NationalbibliothekDeutsche Nationalbibliothek
  • ORCiD Member OrganizationORCiD Member Organization
  • DataCiteDataCite
  • Re3DataRe3Data
  • OpenDOAROpenDOAR
  • OpenAireOpenAire
  • BASE Bielefeld Academic Search EngineBASE Bielefeld Academic Search Engine
Feedback