- Social Robot Interaction and HRI
- Speech and dialogue systems
- AI in Service Interactions
- Language, Metaphor, and Cognition
- Social and Intergroup Psychology
- Natural Language Processing Techniques
- Speech Recognition and Synthesis
- Psychological and Educational Research Studies
- Impact of Technology on Adolescents
- Language, Discourse, Communication Strategies
- Evolutionary Psychology and Human Behavior
- Mobile Crowdsensing and Crowdsourcing
- Second Language Learning and Teaching
- Digital Communication and Language
- Misinformation and Its Impacts
- Ethics and Social Impacts of AI
- Personality Traits and Psychology
- Multimodal Machine Learning Applications
Uppsala University
2024-2025
KTH Royal Institute of Technology
2020-2024
Many small group activities, like working teams or study groups, have a high dependency on the skill of each member. Differences in level among participants can affect not only performance team but also influence social interaction its members. In these circumstances, an active member could balance individual participation without exerting direct pressure specific members by using indirect means communication, such as gaze behaviors. Similarly, this study, we evaluate whether robot language...
The performance of Automatic Speech Recognition (ASR) systems has constantly increased in state-of-the-art development. However, tends to decrease considerably more challenging conditions (e.g., background noise, multiple speaker social conversations) and with atypical speakers children, non-native or people speech disorders), which signifies that general improvements do not necessarily transfer applications rely on ASR, e.g., educational software for younger students language learners. In...
The main aim of this study is to investigate if verbal, vocal, and facial information can be used identify low-engaged second language learners in robot-led conversation practice. experiments were performed on voice recordings video data from 50 conversations, which a robotic head talks with pairs adult using four different interaction strategies varying robot-learner focus initiative. It was found that these robot influenced learner activity engagement. verbal analysis indicated low rated...
Conversation is one of the primary methods interaction between humans and robots. It provides a natural way communication with robot, thereby reducing obstacles that can be faced through other interfaces (e.g., text or touch) may cause difficulties to certain populations, such as elderly those disabilities, promoting inclusivity in Human-Robot Interaction (HRI). Work HRI has contributed significantly design, understanding evaluation human-robot conversational interactions. Concurrently,...
The performance of Automatic Speech Recognition (ASR) systems has constantly increased in state-of-the-art development.However, tends to decrease considerably more challenging conditions (e.g., background noise, multiple speaker social conversations) and with atypical speakers children, non-native or people speech disorders), which signifies that general improvements do not necessarily transfer applications rely on ASR, e.g., educational software for younger students language learners.In...
Abstract The large majority of previous work on human-robot conversations in a second language has been performed with human wizard-of-Oz. reasons are that automatic speech recognition non-native conversational is considered to be unreliable and the dialogue management task selecting robot utterances adequate at given turn complex social conversations. This study therefore investigates if robot-led conversation practice pairs adult learners could potentially managed by an autonomous robot....
Introduction: Backchannels, i.e., short interjections by an interlocutor to indicate attention, understanding or agreement regarding utterances another conversation participant, are fundamental in human-human interaction. Lack of backchannels if they have unexpected timing formulation may influence the negatively, as misinterpretations occur. However, several studies over years shown that there be cultural differences how provided and perceived these affect intercultural conversations....
Abstract This article focuses on designing and evaluating conversation practice in a second language (L2) with robot that employs human spoken non-verbal interaction strategies. Based an analysis of previous work semi-structured interviews L2 learners teachers, recommendations for robot-led adult at intermediate level are first defined, focused learning, the social context, conversational structure verbal visual aspects moderation. Guided by these recommendations, experiment is set up, which...
Uncertainty is a frequently occurring affective state that learners experience during the acquisition of second language. This can constitute both learning opportunity and source learner frustration. An appropriate detection could therefore benefit process by reducing cognitive instability. In this study, we use dyadic practice conversation between an adult second-language social robot to elicit events uncertainty through manipulation robot's spoken utterances (increased lexical complexity...
In this study, non-verbal behavior in diversely-skilled groups was observed while participating a collaborative educational game with humanoid robot. Research has indicated that mediating robot gaze can equalize the verbal contributions from each differently skilled participant, promoting inclusion and learning. The experiment results were further analyzed, extending to effects. initial two experiments under different indicate modifications lead participants. It led increased change...
The recent surge in popularity of Large Language Models, known for their inherent opacity, has increased the interest fostering transparency technology designed human interaction. This concern is equally prevalent development Social Robots, particularly when these are to engage critical areas our society, such as education or healthcare. In this paper we propose an experiment investigate how users can be made aware automated decision processes interacting a discussion with social robot. Our...
Moments of uncertainty are common for learners when practicing a second language. The appropriate management these events could help avoid the development frustration and benefit learner's experience. Therefore, its detection is crucial in language practice conversations. In this study, an experimental conversation between adult learner social robot employed to visually characterize learners' uncertainty. robot's output manipulated prosody lexical levels provoke during conversation. These...
This study deals with turn-taking in human-robot interactions (HRI). Based on 15 sessions of video-recorded between pairs human participants and a social robot called Furhat, we explore how orient to violations the normative order interaction they handle those violations. As case point, present sequences HRI show particular features also may fail respond participants’ bid take turn. In these sequences, either complete turn progress ignore overlap caused by robot’s continuation its turn, or...
People often form immediate expectations about other people, or groups of based on visual appearance and characteristics their voice speech. These stereotypes, inaccurate overgeneralized, may translate to robots that carry human-like qualities. This study aims explore if nationality-based preconceptions regarding accents can be found in people’s perception a virtual physical social robot. In an online survey with 80 subjects evaluating different first-language-influenced English...
Acquiring a second language in adulthood differs considerably from the approach taken at younger ages. Learning rates tend to decrease during adolescence, and socio-emotional characteristics, like motivation expectations, take different perspective for adults. In particular, acquiring communicative competence is stronger objective older learners, as an appropriate use of social contexts ensures better community immersion well-being. This skill best attained through interactions with...