Expanding the Role of Affective Phenomena in Multimodal Interaction Research

• DOI: 10.48550/arxiv.2305.10827
• Publication Date: 2023-01-01
• Authors: Leena Mathur; Maja J. Matarić; Louis‐Philippe Mo...
• Keywords: Affective Computing; Affect; Multimodal Interaction; Multimodality

In recent decades, the field of affective computing has made substantial progress in advancing ability AI systems to recognize and express phenomena, such as affect emotions, during human-human human-machine interactions. This paper describes our examination research at intersection multimodal interaction computing, with objective observing trends identifying understudied areas. We examined over 16,000 papers from selected conferences interaction, natural language processing: ACM International Conference on Multimodal Interaction, AAAC Affective Computing Intelligent Annual Meeting Association for Computational Linguistics, Empirical Methods Natural Language Processing. identified 910 affect-related present analysis role phenomena these papers. find that this body primarily focused enabling machines emotion. However, we limited how emotion predictions might be used by enhance machine understanding human social behaviors cognitive states. Based analysis, discuss directions expand research.