How the Brain Combines Sight and Sound for Clear Communication
Neural substrates of optimal multisensory integration
This project explores how our brains combine what we see and hear, especially during face-to-face conversations, to help us understand speech better.
Quick facts
| Grant type | R01 grant |
|---|---|
| Study type | NIH-funded research |
| Funding institution | University of Pennsylvania NIH-funded |
| Lab location | 1 site (Philadelphia, United States) |
| Project ID | NIH-11143030 on NIH RePORTER |
What this research studies
When we talk face-to-face, our brains naturally combine visual cues from a person's face with the sounds of their voice to help us understand them. This project uses advanced brain imaging (fMRI) and studies epilepsy patients with implanted brain electrodes to understand the specific brain areas involved in this process. Researchers are focusing on a brain region called the posterior superior temporal sulcus/gyrus, which is important for speech perception. They are also looking at how visual illusions can change what we hear, aiming to uncover the fundamental ways our brains process combined sensory information.
Who could benefit from this research
Good fit: Ideal candidates for participation include adults aged 21 and older, particularly those with medically intractable epilepsy who have brain electrodes implanted for treatment.
Not a fit: Patients who are not adults or do not have communication difficulties may not directly benefit from this specific research.
Why it matters
Potential benefit: If successful, this work could lead to better strategies and therapies for individuals with communication challenges, including those with acquired brain injuries.
How similar studies have performed: While the importance of audiovisual speech is well-known, this project uses powerful techniques to explore the specific neural mechanisms and the long-lasting effects of certain illusions in a novel way.
Where this research is happening
Philadelphia, United States
- University of Pennsylvania — Philadelphia, United States (Active)
Researchers
- Principal investigator: Beauchamp, Michael S — University of Pennsylvania
- Study coordinator: Beauchamp, Michael S
About this research
- This is an active NIH-funded research project — typically early-stage science, not a clinical trial accepting patient enrollment.
- Some NIH-funded labs run parallel clinical studies or seek volunteers for related work. To check, contact the principal investigator or institution listed above.
- For full project details, budget, and progress reports, visit the official NIH RePORTER page below.