The study had a panel of licensed healthcare professionals evaluate the responses from both physicians and ChatGPT to 195 randomly drawn patient questions from a social media forum from October 2022.
The panel preferred the ChatGPT responses over those from physicians 78.6 percent of the time, evaluating them based on the quality of information and level of empathy or bedside manner provided.
The study also found that the number of responses rated “empathic” or “very empathetic” was 9.8 times higher for chatbot responses than physician responses. Meanwhile, physician responses were often much shorter, averaging 52 words compared with 211 words from ChatGPT.
At the Becker’s 32nd Annual Meeting: The Business and Operations of ASCs, taking place October 29-31 in Chicago, ASC leaders, surgeons and healthcare executives will explore strategies to drive growth, enhance operational performance, navigate reimbursement challenges and prepare for the future of ambulatory surgery. Apply for complimentary registration now.