Prefer to listen? Here's the narrated myth-vs-reality briefing.
Listen to Healthcare safety and hallucinations
Plus unlocks audio streaming. Pro adds downloadable audio, video, certificates, and more.
The Myth
"AI shouldn't be near medicine" misses how AI is actually being deployed clinically: under physician supervision, on narrowly-scoped tasks (imaging, triage, documentation), with FDA oversight for diagnostic devices. More than 1,350 AI-enabled medical devices have been FDA-cleared. Direct-to-patient diagnostic AI is the exception, not the rule.
Sources:FDA AI/ML-enabled medical devicesNEJM AI Clinical StudiesPLOS Digital Health (2026): outcome evidence for cleared AI devices
The Reality
General-purpose chatbots DO confidently produce wrong medical information, and patients who use them as primary medical advice without clinician involvement face real risk. A 2026 Nature Medicine study sharpened why: when non-experts were given AI diagnostic help, they deferred to it even when it was wrong, and found vague explanations MORE convincing — while clinicians caught the same errors and did best with no explanation at all. Expertise, not the presence of a human, is what makes oversight real. Bias in training data shows up as worse model performance for underrepresented populations. Hospital AI procurement is uneven; deployment without validation has caused documented harms. And clearance is a weaker signal than it sounds: a peer-reviewed 2026 study in PLOS Digital Health traced all 1,357 AI-enabled devices the FDA had cleared and found 34 linked to a registered clinical trial, 12 with a peer-reviewed publication, and only 3 that measured whether patients were actually better off. Regulatory clearance mostly establishes that a device performs a task, not that using it improves outcomes.
The Positive Path
AI is detecting cancers in screening imaging years earlier than human radiologists alone. AI scribes are giving primary-care physicians ~2 hours of their day back. AlphaFold has accelerated drug discovery to the point that the 2024 Nobel Prize in Chemistry recognized it. The right use of AI in medicine is *augmentation under supervision*, and that's where most clinical AI today actually lives.