Creating automated video descriptions for people with visual impairments
Official title: From Human-Powered to Automated Video Description for Blind and Low Vision Users
Funded at Arizona State University-Tempe Campus · NIH-10868424 · Data updated 2026-11-12
This study is working on a smart system that will create audio descriptions for online videos, making it easier for people who are blind or have low vision to enjoy and understand the content they might otherwise miss.
Quick facts
| Grant type | R01 grant |
|---|---|
| Study type | NIH-funded research |
| Funding institution | Arizona State University-Tempe Campus NIH-funded |
| Lab location | 1 site (Tempe, United States) |
| Project start | July 1, 2023 |
| Project end | June 30, 2028 |
| Funding year | 2024 |
| Award (this year) | $625,357 |
| NIH project number | 5R01EY034562-02 |
| Project ID | NIH-10868424 on NIH RePORTER |
Who could benefit from this research
✓Could help
Ideal candidates for this research are individuals with visual impairments who rely on video content for education, employment, and health-related information.
✕Less likely to help
Patients who do not have visual impairments or those who do not engage with video content may not benefit from this research.
What this research studies
This research aims to develop an AI-driven system that automatically generates descriptions for online videos, helping blind and low vision (BLV) users access critical information. Currently, many videos remain undescribed, leaving a significant gap in accessible content. The project will enhance an existing platform, YouDescribe, which allows volunteers to provide audio descriptions, by integrating advanced AI technology to meet the high demand for video descriptions. This approach will enable BLV users to receive timely and relevant information from the vast array of videos available online.
Why it matters
Potential benefit: If successful, this research could significantly improve access to information for blind and low vision individuals, enhancing their ability to make informed decisions in various aspects of life.
How similar studies have gone: Other research has shown success in using AI for accessibility improvements, indicating that this approach has potential for significant impact.
Where this research is happening
-
Arizona State University-Tempe Campus
Tempe, United States Active
Researchers
- Principal investigator: Fazli, Pooyan — Arizona State University-Tempe Campus
- Study coordinator: Fazli, Pooyan
Related research
Other NIH-funded projects on the same topics.
-
Understanding how herpesviruses move and exit cells (focus on HSV-1 and PRV)
Scientists are studying how herpesviruses travel inside nerve cells and exit at the right spots, which could lead to better prevention and treatment of infections in people and animals.
-
Whole Protein Arrays to Find Antibodies Linked to Islet Autoimmunity in a Big Birth Cohort
This NIH grant aims to map antibodies against many microbes in children from the TEDDY study to understand what infections might be linked to the development of type 1 diabetes.
-
Climate heat and Alzheimer's risk in older adults
Heat exposure may influence brain health and dementia risk in older adults living in the United States.
-
Certified Cancer Registry Extraction with Proof-Certified Trust
A new AI-powered system helps cancer registries extract standardized data from medical records more accurately and with formal proofs to ensure trust.
-
Demystifying E. coli ecosystems with synthetic microbial communities
A project builds controlled, synthetic E. coli communities to uncover how different interactions shape colony behavior and health-related outcomes.
-
Aflatoxin exposure and child growth in Guatemala
A study in rural Guatemala will track how exposure to aflatoxin relates to growth and gut health in young children.
About this research
- This is an active NIH-funded research project — typically early-stage science, not a clinical trial accepting patient enrollment.
- Some NIH-funded labs run parallel clinical studies or seek volunteers for related work. To check, contact the principal investigator or institution listed above.
- For full project details, budget, and progress reports, visit the official NIH RePORTER page.