Understanding how visual cues help improve speech perception
Official title: Characterizing the recovery of spectral, temporal, and phonemic speech information from visual cues
Funded at University of Michigan at Ann Arbor · NIH-11009943 · Data updated 2026-11-12
This study looks at how watching lip movements and facial expressions can help people, especially those with hearing difficulties from aging or injuries, better understand speech in noisy places, with the goal of improving communication and social interactions for them.
Quick facts
| Grant type | R01 grant |
|---|---|
| Study type | NIH-funded research |
| Funding institution | University of Michigan at Ann Arbor NIH-funded |
| Lab location | 1 site (Ann Arbor, United States) |
| Project start | February 14, 2023 |
| Project end | January 31, 2028 |
| Funding year | 2025 |
| Award (this year) | $537,325 |
| NIH project number | 5R01DC020717-03 |
| Project ID | NIH-11009943 on NIH RePORTER |
Who could benefit from this research
✓Could help
Ideal candidates for this research include individuals experiencing age-related hearing loss, those with acquired brain injuries, or anyone facing challenges in speech perception due to auditory deficits.
✕Less likely to help
Patients with normal hearing or those whose speech perception issues are not related to auditory-visual interactions may not benefit from this research.
What this research studies
This research investigates how visual information, such as lip movements and facial expressions, can enhance the ability to understand speech, especially in challenging listening environments. It focuses on individuals who may struggle with hearing due to age-related decline, brain injuries, or other auditory impairments. By exploring the interactions between auditory and visual signals, the study aims to develop a better understanding of how these cues can be used to improve communication and social interactions for those affected. The research employs a dual-route perceptual model to analyze how visual signals can integrate with auditory information to support speech perception.
Why it matters
Potential benefit: If successful, this research could lead to improved communication strategies and tools for individuals with hearing impairments, enhancing their social and emotional well-being.
How similar studies have gone: Previous research has shown promising results in using visual cues to aid speech perception, indicating that this approach has potential for further exploration.
Where this research is happening
-
University of Michigan at Ann Arbor
Ann Arbor, United States Active
Researchers
- Principal investigator: Brang, David — University of Michigan at Ann Arbor
- Study coordinator: Brang, David
Related research
Other NIH-funded projects on the same topics.
-
Silent speech interface using a wearable tongue tracker to help people after laryngectomy communicate
A wearable system with tongue sensors and intraoral components aims to let people without a vocal cord use natural-sounding speech in daily life.
-
Overlap between how we speak and how we hold words in memory
A Duke-led project studies how the brain that talks relates to keeping verbal information in working memory, using advanced brain recordings from patients already undergoing medical care.
-
AI-powered system to improve teamwork in cardiac surgery
A research project is testing an AI-driven system that listens to team conversations during heart surgeries to spot teamwork patterns and give real-time feedback to improve patient safety.
-
Caregiver Speech and Infant Brain Development in Siblings of Children with Autism
This project follows babies who have an older sibling with autism to explore how caregiver talk and everyday interactions relate to early brain and behavior development.
-
How speech and swallowing work in people with Down syndrome
Researchers will look at how differences in the mouth, throat, and brain affect speech clarity and safe swallowing in children and adults with Down syndrome.
-
Information and social media use for autism info in young children
A research project looks at how speech-language pathologists and parents of young autistic children use social media for information and what makes that information trustworthy.
About this research
- This is an active NIH-funded research project — typically early-stage science, not a clinical trial accepting patient enrollment.
- Some NIH-funded labs run parallel clinical studies or seek volunteers for related work. To check, contact the principal investigator or institution listed above.
- For full project details, budget, and progress reports, visit the official NIH RePORTER page.