Accuracy of ChatGPT in Common Gastrointestinal Diseases: Impact for Patients and Providers

• DOI: 10.1016/j.cgh.2023.11.008
• Publication Date: 2023-11-19T03:22:34Z
• Authors: Anthony Kerbage; Joseph Kassab; Joseph El Dahdah; Carol A. Burke; Jean-Paul Achkar; Carol Rouphael

Since its release in 2022, Chat Generative Pre-Trained Transformer (ChatGPT) became the most rapidly expanding consumer software application in history,1 and its role in medicine is underscored by its potential to enhance patient education and physician-patient communication. Previous studies in gastroenterology and hepatology have focused primarily on the earlier Generative Pre-Trained Transformer 3 (GPT-3) model, with none investigating ChatGPT's ability to generate supportive references for its responses, or its applicability as a physician educational tool.2-6 Our study evaluated the accuracy of the more recent ChatGPT, powered by GPT-4, in addressing frequently asked questions by patients on irritable bowel syndrome (IBS), inflammatory bowel disease (IBD), colonoscopy and colorectal cancer (CRC) screening, questions on CRC screening from a physician perspective, and reference generation and suitability.