Parents seeking health information for their children trusted AI-generated content more than health care professionals when the author is unknown, raising concerns about the accuracy and potential risks of relying on AI for critical health decisions.
Summary: A University of Kansas study found that parents often trust AI-generated health information for their children more than advice from healthcare professionals when the authorship is unknown. The study highlights concerns about the increasing reliance on AI for critical health decisions, as generative AI can produce inaccurate information. Researchers urge parents to consult experts and verify AI-sourced information.
Key Takeaways:
- Parents Trust AI Over Healthcare Experts: The study found that when the authorship was unknown, parents rated AI-generated health information as more trustworthy, accurate, and reliable than content from healthcare professionals.
- Risks of Inaccurate AI Advice: Researchers raised concerns about AI “hallucinations,” where AI-generated information can be incorrect due to a lack of proper context, posing significant risks for child health decisions.
- Expert Oversight is Crucial: The study emphasizes that while AI can be a useful tool, parents should always verify health information with healthcare professionals to ensure accuracy and safe decision-making.
New research from the University of Kansas Life Span Institute highlights a key vulnerability to misinformation generated by artificial intelligence (AI) and a potential model to combat it.
The study, appearing in the Journal of Pediatric Psychology, reveals parents seeking health care information for their children trust AI more than health care professionals when the author is unknown, and parents also rate AI-generated text as credible, moral, and trustworthy.
“When we began this research, it was right after ChatGPT first launched—we had concerns about how parents would use this new, easy method to gather health information for their children,” says lead author Calissa Leslie-Miller, University of Kansas doctoral student in clinical child psychology, in a release. “Parents often turn to the internet for advice, so we wanted to understand what using ChatGPT would look like and what we should be worried about.”
Rating AI and Expert Text
Leslie-Miller and her colleagues conducted a cross-sectional study with 116 parents, aged 18 to 65, who were given health-related text, such as information on infant sleep training and nutrition. They reviewed content generated by both ChatGPT and by health care professionals, though participants were not informed of the authorship.
“Participants rated the texts based on perceived morality, trustworthiness, expertise, accuracy, and how likely they would be to rely on the information,” Leslie-Miller says in a release.
Surprising Outcomes
According to the researcher, in many cases, parents couldn’t distinguish between the content generated by ChatGPT and that by experts. When there were significant differences in ratings, ChatGPT was rated as more trustworthy, accurate, and reliable than the expert-generated content.
“This outcome was surprising to us, especially since the study took place early in ChatGPT’s availability,” says Leslie-Miller in a release. “We’re starting to see that AI is being integrated in ways that may not be immediately obvious, and people may not even recognize when they’re reading AI-generated text versus expert content.”
Raising Concerns for Child Health Care
Leslie-Miller says the findings raise concerns because generative AI now powers responses that appear to come from apps or the internet but are actually conversations with an AI.
“During the study, some early iterations of the AI output contained incorrect information,” she says in a release. “This is concerning because, as we know, AI tools like ChatGPT are prone to ‘hallucinations’—errors that occur when the system lacks sufficient context.”
Although ChatGPT performs well in many cases, Leslie-Miller says the AI model isn’t an expert and is capable of generating wrong information.
“In child health, where the consequences can be significant, it’s crucial that we address this issue,” she says in a release. “We’re concerned that people may increasingly rely on AI for health advice without proper expert oversight.”
The authors report, “Results indicate that prompt-engineered ChatGPT is capable of impacting behavioral intentions for medication, sleep, and diet decision-making.”
Leslie-Miller says the life-and-death importance of pediatric health information helps to amplify the problem, but that the possibility that generative AI can be wrong and users may not have the expertise to identify inaccuracies extends to all topics.
Consumers ‘Need to Be Cautious’
She suggests consumers of AI information need to be cautious and only rely on information that is consistent with expertise that comes from a nongenerative AI source.
“There are still differences in the trustworthiness of sources,” she says in a release. “Look for AI that’s integrated into a system with a layer of expertise that’s double-checked—just as we’ve always been taught to be cautious about using Wikipedia because it’s not always verified. The same applies now with AI—look for platforms that are more likely to be trustworthy, as they are not all equal.”
Indeed, Leslie-Miller says AI could be a benefit to parents looking for health information so long as they understand the need to consult with health professionals as well.
“I believe AI has a lot of potential to be harnessed. Specifically, it is possible to generate information at a much higher volume than before,” she says in a release. “But it’s important to recognize that AI is not an expert, and the information it provides doesn’t come from an expert source.”
ID 320280112 © Minirhenyx | Dreamstime.com
