Understanding how seeing a speaker's face affects listening effort for people with hearing loss
Official title: Listening Effort and Gaze Strategies During Audiovisual Speech Perception
Funded at University of Minnesota · NIH-10994158 · Data updated 2026-11-12
This study looks at how watching a speaker's face can make it easier and less tiring for people with hearing loss, especially those using cochlear implants, to understand conversations, and it aims to find better ways to help them communicate in everyday situations.
Quick facts
| Grant type | R21 grant |
|---|---|
| Study type | NIH-funded research |
| Funding institution | University of Minnesota NIH-funded |
| Lab location | 1 site (Minneapolis, United States) |
| Project start | December 4, 2023 |
| Project end | November 30, 2026 |
| Funding year | 2025 |
| Award (this year) | $193,452 |
| NIH project number | 5R21DC021495-02 |
| Project ID | NIH-10994158 on NIH RePORTER |
Who could benefit from this research
✓Could help
Ideal candidates for this research are individuals with hearing loss, particularly those using cochlear implants.
✕Less likely to help
Patients with normal hearing or those who do not use cochlear implants may not benefit from this research.
What this research studies
This research investigates how visual cues from a speaker's face can reduce listening effort and fatigue for individuals with hearing loss, particularly those using cochlear implants. The study will explore how listeners engage with visual speech cues during real-life conversations, focusing on eye gaze behavior and its relationship to speech perception effort. By examining these dynamics, the research aims to enhance communication strategies for individuals facing challenges in auditory environments.
Why it matters
Potential benefit: If successful, this research could lead to improved communication strategies that enhance the quality of life for individuals with hearing loss.
How similar studies have gone: Previous research has shown that visual cues can improve speech intelligibility, suggesting potential success for this approach.
Where this research is happening
-
University of Minnesota
Minneapolis, United States Active
Researchers
- Principal investigator: Fleming, Justin Tracy — University of Minnesota
- Study coordinator: Fleming, Justin Tracy
Related research
Other NIH-funded projects on the same topics.
-
Silent speech interface using a wearable tongue tracker to help people after laryngectomy communicate
A wearable system with tongue sensors and intraoral components aims to let people without a vocal cord use natural-sounding speech in daily life.
-
Overlap between how we speak and how we hold words in memory
A Duke-led project studies how the brain that talks relates to keeping verbal information in working memory, using advanced brain recordings from patients already undergoing medical care.
-
AI-powered system to improve teamwork in cardiac surgery
A research project is testing an AI-driven system that listens to team conversations during heart surgeries to spot teamwork patterns and give real-time feedback to improve patient safety.
-
Caregiver Speech and Infant Brain Development in Siblings of Children with Autism
This project follows babies who have an older sibling with autism to explore how caregiver talk and everyday interactions relate to early brain and behavior development.
-
How speech and swallowing work in people with Down syndrome
Researchers will look at how differences in the mouth, throat, and brain affect speech clarity and safe swallowing in children and adults with Down syndrome.
-
Information and social media use for autism info in young children
A research project looks at how speech-language pathologists and parents of young autistic children use social media for information and what makes that information trustworthy.
About this research
- This is an active NIH-funded research project — typically early-stage science, not a clinical trial accepting patient enrollment.
- Some NIH-funded labs run parallel clinical studies or seek volunteers for related work. To check, contact the principal investigator or institution listed above.
- For full project details, budget, and progress reports, visit the official NIH RePORTER page.