: First during puberty, as the vocal cords thicken and the voice box migrates down the throat. Then a second time as aging causes structural changes that may weaken the voice.
But for some of us, there’s another voice shift, when a disease begins or when our mental health declines.
This is why more doctors are looking into voice as a biomarker – something that tells you that a disease is present.
Vital signs like blood pressure or heart rate “can give a general idea of how sick we are. But they’re not specific to certain diseases,” says Yael Bensoussan, MD, director of the University of South Florida, Tampa’s Health Voice Center and the coprincipal investigator for the National Institutes of Health’s Voice as a Biomarker of Health project.
“We’re learning that there are patterns” in voice changes that can indicate a range of conditions, including diseases of the nervous system and mental illnesses, she says.
Speaking is complicated, involving everything from the lungs and voice box to the mouth and brain. “A breakdown in any of those parts can affect the voice,” says Maria Powell, PhD, an assistant professor of otolaryngology (the study of diseases of the ear and throat) at Vanderbilt University, Nashville, Tenn., who is working on the NIH project.
You or those around you may not notice the changes. But researchers say voice analysis as a standard part of patient care – akin to blood pressure checks or cholesterol tests – could help identify those who need medical attention earlier.
Often, all it takes is a smartphone – “something that’s cheap, off-the-shelf, and that everyone can use,” says Ariana Anderson, PhD, director of the University of California, Los Angeles, Laboratory of Computational Neuropsychology.
“You can provide voice data in your pajamas, on your couch,” says Frank Rudzicz, PhD, a computer scientist for the NIH project. “It doesn’t require very complicated or expensive equipment, and it doesn’t require a lot of expertise to obtain.” Plus, multiple samples can be collected over time, giving a more accurate picture of health than a single snapshot from, say, a cognitive test.
Over the next 4 years, the Voice as a Biomarker team will receive nearly $18 million to gather a massive amount of voice data. The goal is 20,000-30,000 samples, along with health data about each person being studied. The result will be a sprawling database scientists can use to develop algorithms linking health conditions to the way we speak.
For the first 2 years, new data will be collected exclusively via universities and high-volume clinics to control quality and accuracy. Eventually, people will be invited to submit their own voice recordings, creating a crowdsourced dataset. “Google, Alexa, Amazon – they have access to tons of voice data,” says Dr. Bensoussan. “But it’s not usable in a clinical way, because they don’t have the health information.”
Dr. Bensoussan and her colleagues hope to fill that void with advance voice screening apps, which could prove especially valuable in remote communities that lack access to specialists or as a tool for telemedicine. Down the line, wearable devices with voice analysis could alert people with chronic conditions when they need to see a doctor.
“The watch says, ‘I’ve analyzed your breathing and coughing, and today, you’re really not doing well. You should go to the hospital,’ ” says Dr. Bensoussan, envisioning a wearable for patients with COPD. “It could tell people early that things are declining.”
Artificial intelligence may be better than a brain at pinpointing the right disease. For example, slurred speech could indicate Parkinson’s, a stroke, or ALS, among other things.
“We can hold approximately seven pieces of information in our head at one time,” says Dr. Rudzicz. “It’s really hard for us to get a holistic picture using dozens or hundreds of variables at once.” But a computer can consider a whole range of vocal markers at the same time, piecing them together for a more accurate assessment.
“The goal is not to outperform a ... clinician,” says Dr. Bensoussan. Yet the potential is unmistakably there: In a recent study of patients with cancer of the larynx, an automated voice analysis tool more accurately flagged the disease than laryngologists did.
“Algorithms have a larger training base,” says Dr. Anderson, who developed an app called ChatterBaby that analyzes infant cries. “We have a million samples at our disposal to train our algorithms. I don’t know if I’ve heard a million different babies crying in my life.”
So which health conditions show the most promise for voice analysis? The Voice as a Biomarker project will focus on five categories.