A dearth of pediatric data collected using artificial intelligence (AI) tools could compromise the understanding of early sleep patterns and lead to misdiagnosis of sleep disorders in children, according to a study published in Sleep Medicine.
“Sleep stages are primarily determined by analyzing the brain waves during sleep, which traditionally is done manually (or semi-automated),” says the University of Adelaide’s associate professor Mathias Baumert of the School of Electrical and Mechanical Engineering, in a release. “There has been a big push to automate this labor-intensive and expensive process using deep learning—an AI method that teaches computers to process data in a way that is inspired by the human brain.”
Baumert says in the release that he and co-investigators have found evidence that errors in sleep classification generated using AI could lead to misdiagnosis of sleep disorders, particularly in children.
Nerve impulses in the brain cause electrical activity. An electroencephalogram (EEG) records the brain’s electrical activity on a person’s scalp. Collected overnight, it provides the input data to deep learning systems.
“Deep learning systems need big EEG databases to learn the brain wave patterns associated with various sleep stages to give reliable results,” says Baumert in the release. “However, most available sleep EEG databases contain adult data only, and therefore, the systems developed on those databases seem to have issues when dealing with kids’ sleep because they have never ‘seen’ and ‘learnt’ it. This means sleep disorders in children could be misdiagnosed due to using adult-biased data sets.”
The association between sleep problems, cognitive development, and mental health has long been studied and recognized. Early identification of sleep problems, especially in young people, is vital to maximizing the effectiveness of appropriate treatment, according to a release from the University of Adelaide.
Generally, sleep comprises rapid eye movement sleep and non-rapid eye movement sleep. Non-rapid eye movement sleep is categorized into three stages (N1, N2, N3). Prior to the introduction of AI methods for classifying sleep patterns, a technician would examine overnight EEG, 30 seconds at a time, and assign one of the sleep stages to it.
“Sleep follows a typical cyclical pattern of sleep stages that make up the ‘sleep architecture’ and can be seen in a hypnogram—a graph that represents the stages of sleep over time,” says Baumert in the release. “Clinicians consider several metrics from hypnograms, such as sleep onset latency, sleep efficiency, time spent in each of the sleep stages, and time spent awake after sleep onset, to help them diagnose sleep disorders.”
On adult EEG, AI systems assign sleep stages correctly about nine out of 10 times—on par with human experts. A similar performance can be achieved for children if pediatric data are included in the deep learning process.
Study co-author Huy Phan, PhD, Alan Turing Institute, says improvements are needed in AI systems to avoid bias toward population groups and ensure accurate diagnoses for all patients.
“Even if trained with pediatric data, current AI systems don’t work equally well in all patients. While sleep stage classification accuracy appears sufficient when looking at EEG databases as a whole, errors in the sleep metrics of individual patients can be substantial, which is unacceptable for any diagnostic purpose,” says Phan in a release. “Effective strategies are needed to avoid bias in the learning process and also to identify unusual behavior of AI systems and mitigate the risk of misdiagnoses.”
Photo 119963382 © Mladen Zivkovic | Dreamstime.com
