A chatbot told a patient their delusions were real, so why are we asking if AI can replace doctors?

I’ve read quite a few articles recently that all ask the same question: Could AI take the place of your romantic partner/friends/therapist/doctor?

Probably a better question to ask would be: Should it?

Most GPs, and a good proportion of our patients, already know that Dr Google is an unreliable, seriously neurotic source of medical information that basically screams “Cancer!” when asked about any and every minor symptom.

But what about AI?