Responses of Five Different Artificial Intelligence Chatbots to the Top Searched Queries About Erectile Dysfunction: A Comparative Analysis

• DOI: 10.1007/s10916-024-02056-0
• Publication Date: 2024-04-03T06:01:46Z
• Authors: Mehmet Fatih Şahin; Hüseyin Ateş; Anıl Keleş; Rıdvan Özcan; Çağrı Doğan; Murat Akgül; Cenk Murat Yazıcı
• Keywords: Chatbot

Abstract The aim of the study is to evaluate and compare quality readability responses generated by five different artificial intelligence (AI) chatbots—ChatGPT, Bard, Bing, Ernie, Copilot—to top searched queries erectile dysfunction (ED). Google Trends was used identify ED-related relevant phrases. Each AI chatbot received a specific sequence 25 frequently terms as input. Responses were evaluated using DISCERN, Ensuring Quality Information for Patients (EQIP), Flesch-Kincaid Grade Level (FKGL) Reading Ease (FKRE) metrics. three most phrases “erectile cause”, “how dysfunction,” treatment.” Zimbabwe, Zambia, Ghana exhibited highest level interest in ED. None chatbots achieved necessary degree readability. However, Bard significantly higher FKRE FKGL ratings ( p = 0.001), Copilot better EQIP DISCERN than other 0.001). simplest linguistic framework posed least challenge comprehension, Copilot’s text on ED superior chatbots. As new are introduced, their understandability increase, providing guidance patients.