Synthetic Minds | AI Has Gone From Advising to Prescribing Medication

Synthetic Minds | AI Has Gone From Advising to Prescribing Medication

The Synthetic Minds newsletter offers short daily insights to get you thinking. If you enjoy it, please forward. All signals are powered by Futurwise. If you need more insights, subscribe to Futurwise and get 25% off for the first three months!

I have just launched the Intelligence Age Scorecard! It will help you understand how ready your organization is for the Intelligence Age.

Today’s topic: Health & Longevity

When Your Prescriber Is Software, Who Is Liable?

An AI is adjusting the insulin of patients inside the Cleveland Clinic. A doctor set the limits, but the software carries the change forward. It is FDA-cleared, and it is live.

The AI in medicine has stopped advising the human decision and started making part of it.

A patient-facing AI agent talks to people and adjusts their insulin within limits a physician sets, deployed at Cleveland Clinic, Allegheny Health Network, and UCSF Health.

The cleared device is bounded; a narrow insulin tool wrapped in conversation. The precedent is not bounded at all.

The government has funded the sequel: the first agent authorized to adjust heart medication around the clock, on a multi-year path to approval.

On the payment side, the rule that algorithms may help decide what care gets covered was already settled a few years ago.

Prescription at one end, coverage at the other. The software has a hand on both ends.

That's the efficiency story. Here is the signal.

The AI in medicine has spent a decade as the quiet assistant. It read the scan, drafted the note, flagged the clot. A human always decided.

That arrangement has ended, and the announcements dressed the ending as a product launch.

An agent that acts is a different machine from an agent that advises. When it adjusts a dose, it operates where a mistake causes physical harm. That raises a question the advisory era never had to answer.

Who answers for what the software does to a patient? The federal briefing on the heart-care agent names the gap the press releases skip: responsibility among the developer, the supervising clinician, and the hospital is unsettled. No one has signed for it.

Two costs hide behind the convenience. An always-available, confident agent invites doctors and patients to trust it exactly where trust is most dangerous. And a handful of vendors become load-bearing infrastructure for care, so a model update becomes a safety event rather than a support ticket.

Aviation learned this order the hard way. The autopilot flew, the captain kept the title, and it took a generation of accidents to settle accountability when the two disagreed. Medicine has put the autopilot in the exam room and skipped that argument.

The machine that frames the choice while the human signs for it has reached the bedside.

The question is no longer whether the machine is accurate. It is who is accountable the first time it is confidently wrong, and whether anyone signed for that before the agent went to work.

The Intelligence Age Scorecard

An FDA-cleared AI agent has begun adjusting patients' medication inside major health systems, and the accountability for its actions is unsettled. That is a WAVE question: are you still watching this shift, or should your clinical-governance and risk teams already be adapting to a world where the prescriber is partly software?

Benchmark your readiness for the next two quarters with the Intelligence Age Scorecard. Or read the public Intelligence Age Scorecard of IBM, Visa, Qantas, Woolworths, Telstra or Commonwealth Bank first.

If this newsletter was forwarded to you, you can sign up here.

Thank you.
Mark