Pancreatitis, party mishaps and panic — the clinical cases where AI fails

Canadian researchers put the AI model through its paces on 150 clinical cases.

Imaging misinterpretation was meant to fall quickly to AI’s diagnostic supremacy, but a study of 150 clinical challenges suggests that imaging, numbers and party hijinks are actually the areas where AI struggles.

Researchers from Western University in Ontario, Canada, put free AI software ChatGPT up against the multiple-choice challenges from website Medscape, finding that the AI correctly answered 49%.