Detecting emotions during a memory training assisted by a social robot for individuals with Mild Cognitive Impairment (MCI)

• DOI: 10.1007/s11042-020-10092-4
• Publication Date: 2020-11-07T04:39:57Z
• Authors: Giuseppe Palestra; Olimpia Pino
• Keywords: Mild Cognitive Impairment; 000; Computer Networks and Communications; 150; 16. Peace & justice; 03 medical and health sciences; 0302 clinical medicine; Hardware and Architecture; Social robot; Media Technology; Facial expression recognition; Memory training; Software

AbstractThe attention towards robot-assisted therapies (RAT) had grown steadily in recent years particularly for patients with dementia. However, rehabilitation practice using humanoid robots for individuals with Mild Cognitive Impairment (MCI) is still a novel method for which the adherence mechanisms, indications and outcomes remain unclear. An effective computing represents a wide range of technological opportunities towards the employment of emotions to improve human-computer interaction. Therefore, the present study addresses the effectiveness of a system in automatically decode facial expression from video-recorded sessions of a robot-assisted memory training lasted two months involving twenty-one participants. We explored the robot’s potential to engage participants in the intervention and its effects on their emotional state. Our analysis revealed that the system is able to recognize facial expressions from robot-assisted group therapy sessions handling partially occluded faces. Results indicated reliable facial expressiveness recognition for the proposed software adding new evidence base to factors involved in Human-Robot Interaction (HRI). The use of a humanoid robot as a mediating tool appeared to promote the engagement of participants in the training program. Our findings showed positive emotional responses for females. Tasks affects differentially affective involvement. Further studies should investigate the training components and robot responsiveness.