Two recent studies looked at whether AI can reliably answer your health questions.

The first (PMID: 41980854) audited 5 chatbots - including ChatGPT and Gemini - across 250 health questions.

Nearly half (49.6%) of the responses were problematic.

1 in 5 were highly problematic.

Here’s the kicker: The 2 worst performing categories were athletic performance and nutrition. My wheelhouse.

he second (PMID: 41663592) looked at 1,298 people with real medical scenarios. The AI working alone identified the right condition 94.9% of the time. BUT the same AI tool when used by the person, accuracy dropped to 34.5%. That’s las reliable as sing a search engine to self-diagnose.
​

The problem? Users leave out information that matters. Questions get misread. Information disappears during the interaction. But every AI answer came back confident and certain. Yikes.

This is why I cringe when someone comes to a call with me and tells me about their over-reliance on wearables, online calculators, and AI for training decisions.

These tools are great but they can’t analyze the full picture because YOU aren’t trained to give them all the right information they need to make an accurate diagnosis.

When I’m gathering information from a client, I’m:

• poking at their responses with a ton of clarifying questions
• getting them to expand on things provide more detail
• isolating emotionally-driven data
• assigning standardized tests to assess true physical capacity in 9 key areas
• and then distilling it all down to a set of data points that paint the full picture.

I’ll always rely on skilled, curious human practitioners for evaluation, diagnosis, and strategy with things that matter most to me.

It’s also why I do the work I do. Women come me who are injured and frustrated with poor performance - having long outsourced their data collection & analysis to technology rather than humans - but nothing improves.

The real risk here is that these women often think they are the problem. They blame their bodies when AI can’t fix them. That is not okay.

Real humans have value that robots can’t duplicate.

I share this today as a reminder to keep the humans IN the data collection and decision making on the things that matter most to you.

-A

P.O. Box 601, Clarksburg, MD 20871
​Unsubscribe · Preferences​