Up to 200,000 Americans can now ask an Apple app about their health, and none of them is buying a product. They are joining a research study. In our view, that is the right way to bring chatbots into medicine, and the rest of the industry should do the same.
The study opened in the United States on 15 November, in partnership with a clinical AI company that many doctors already use. That company, OpenEvidence, builds its answers from medical journals such as The New England Journal of Medicine, JAMA and Nature. Each answer comes with links to the research behind it.
People who join can choose to share data from Apple Health, such as resting heart rate, sleep or lab results. Apple wants to see whether that personal data makes the answers more useful. To take part, people must be 21 or older and own an iPhone 15 Pro or a later model.
What Apple wants to learn
Apple says it will measure four things: whether people trust the answers, how good the answers are, whether people understand them and what they do next. Participants rate the answers and fill in monthly surveys. The study is due to run for more than 12 months, according to a report on its launch.
Apple is also frank about the risk. “Consumer health technologies powered by LLMs may at times offer responses that are incomplete or unclear,” its announcement says. LLMs, or large language models, are the technology behind chatbots such as ChatGPT.
The privacy terms are strict. Study data will not be used to train AI models. Apple says the data is made anonymous before it is sent to an outside cloud provider, and OpenEvidence deletes questions and answers after 24 hours, TechCrunch reported.
Most health chatbots skipped this step
More than 230 million people ask health and wellness questions on the most popular chatbot every week, its maker said in January. That figure is for ChatGPT alone. In July, OpenAI opened a separate health section in the app to users in the US aged 18 and over.
OpenAI has tested its models with a benchmark, a fixed set of questions marked like an exam. It grades answers to 5,000 realistic health conversations against rules written by 262 doctors. A test like this can show whether an answer is accurate. It cannot show whether a worried person understood the answer, or whether they called a doctor afterwards. That is the question Apple’s study is trying to answer.
Where the study falls short
The study has limits. Only people with a recent high-end iPhone can join, so the results may say little about people who find it hardest to see a doctor. The announcement also does not say whether or when Apple will publish what it finds.
Yet the app’s page in the App Store reads like an advert. The listing invites people to ask the app all their health questions and to build exercise or meal plans. It also says that neither the app nor the study gives medical advice, diagnosis or treatment.
Still, the order is right: test first, then sell. Last week we argued that people should not have to give up their privacy to use an AI assistant. Apple’s terms show that strict limits are possible: the data is not used to train AI, and questions are deleted after 24 hours.
Why it matters: Hundreds of millions of people already ask chatbots about their health each week, and there is little public evidence on whether those answers help them. A study this large could provide that evidence, but only if Apple publishes the results.
The post Apple Is Right to Test Its Health Chatbot Before a Full Launch appeared first on DailyAI.
