EP6.91 Assessment Of The Role Of ChatGPT As A Supplementary Tool For Providing Information Regarding Hip Arthroscopy

• DOI: 10.1093/jhps/hnaf011.380
• Publication Date: 2025-03-30T18:14:21Z
• Authors: Emre Anıl Özbek; Mustafa Onur Karaca; Peri Kından; Mehmet Batu Ertan; Safa Gürsoy; Jorge Chahla

Abstract Purpose: To assess the accuracy of responses of ChatGPT (an advanced language model developed by OpenAI) to common patient questions regarding hip arthroscopy compared with current literature. Methods: Twenty-five common patient questions, extracted from Google in English, were asked ChatGPT regarding the preoperative and postoperative periods of hip arthroscopy. Two board certified orthopaedic sports medicine surgeons investigated the accuracy of the responses and compared them with current literature. Responses were scored as “excellent response not requiring clarification”, “satisfactory requiring minimal clarification”, “satisfactory requiring moderate classification” or “unsatisfactory requiring substantial clarification”. All responses were prompted by providing different age (20, 40, and 60 years) and sex of the patients. Results: The chatbot provided patients with 56% excellent and 40% satisfactory responses in the context of literature; however, 4% of responses were unsatisfactory, and required further clarification. Of the responses to 10 preoperative questions, one was “unsatisfactory”, six were “satisfactory,” and three were “excellent”. None of the responses to the 15 postoperative questions were unsatisfactory; 4 responses were “satisfactory” and 11 were “excellent”. In addition, ChatGPT provided the same answers regardless of patients’ age and sex. Conclusions: ChatGPT provided 96% satisfactory answers to questions regarding preoperative and postoperative periods of hip arthroscopy. The findings show that ChatGPT offers a supplementary tool for patients. Nonetheless, ChatGPT cannot prevail over the expertise of orthopaedic surgeons in diagnosis and treatment planning because it has a limited capacity to evaluate patient demographics. Clinical Relevance: This study compared the answers of ChatGPT to patients’ questions regarding hip arthroscopy with the current literature. As ChatGPT has gained popularity among patients, the study aimed to find if the responses patients get from this chatbot is compatible with the up-to-date literature.