ChatGPT 3.5 provides inappropriate cancer treatment recommendations in one-third of cases, study shows

Reviewed by Danielle Ellis, B.Sc.Aug 25 2023 Their findings, published in JAMA Oncology, show that in approximately one-third of cases, ChatGPT 3.5 provided an inappropriate recommendation, highlighting the need for awareness of the technology's limitations.

Danielle Bitterman, MD, Corresponding Author, Department of Radiation Oncology and the Artificial Intelligence in Medicine Program of Mass General Brigham Although medical decision-making can be influenced by many factors, Bitterman and colleagues chose to evaluate the extent to which ChatGPT's recommendations aligned with the NCCN guidelines, which are used by physicians at institutions across the country. They focused on the three most common cancers and prompted ChatGPT to provide a treatment approach for each cancer based on the severity of the disease.

Related StoriesIn 12.5 percent of cases, ChatGPT produced "hallucinations," or a treatment recommendation entirely absent from NCCN guidelines. These included recommendations of novel therapies, or curative therapies for non-curative cancers. The authors emphasized that this form of misinformation can incorrectly set patients' expectations about treatment and potentially impact the clinician-patient relationship.

Technology Technology Latest News, Technology Technology Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

ChatGPT shows limited ability to recommend guidelines-based cancer treatmentsFor many patients, the internet serves as a powerful tool for self-education on medical topics. With ChatGPT now at patients' fingertips, researchers from Brigham and Women's Hospital, a founding member of the Mass General Brigham health care system, assessed how consistently the artificial intelligence chatbot provides recommendations for cancer treatment that align with National Comprehensive Cancer Network (NCCN) guidelines.
Source: medical_xpress - 🏆 101. / 51 Read more »

AI can achieve better grades than university students, report suggestsNew research found Sam Altman's ChatGPT matched or performed better than students when answering assessment questions. Model outperformed in psychology and others.
Source: DailyMailUK - 🏆 7. / 90 Read more »