AI in Relationship Counselling: Evaluating ChatGPT’s Therapeutic Capabilities in Providing Relationship Advice

• DOI: 10.31234/osf.io/3zajt
• Publication Date: 2023-10-30T05:00:28Z
• Authors: Laura Marika Vowels; Rachel Francois-W...; Joëlle Darwiche
• Keywords: Artificial intelligence; Relationship advice; Chatbots; Electronic computers. Computer science; QA75.5-76.95; Information technology; Large language models; T58.5-58.64

Recent advancements in AI have led to chatbots, such as ChatGPT, capable of providing therapeutic responses. Early research evaluating chatbots’ ability to provide relationship advice and single-session relationship interventions has showed that both laypeople and relationship therapists rate them high on attributed such as empathy and helpfulness. In the present study, 20 participants engaged in single-session relationship intervention with ChatGPT and were interviewed about their experiences. We evaluated the performance of ChatGPT comprising of technical outcomes such as error rate and linguistic accuracy and therapeutic quality such as empathy and therapeutic questioning. The interviews were analysed using reflexive thematic analysis which generated four themes: light at the end of the tunnel; clearing the fog; clinical skills; and therapeutic setting. The analyses of technical and feasibility outcomes, as coded by researchers and perceived by users, show ChatGPT provides realistic single-session intervention with it consistently rated highly on attributes such as therapeutic skills, human-likeness, exploration, and useability, and providing clarity and next steps for users’ relationship problem. Limitations include a poor assessment of risk and reaching collaborative solutions with the participant. This study extends on AI acceptance theories and highlights the potential capabilities of ChatGPT in providing relationship advice and support.