AI-powered video guidance to help blind and low-vision people do daily tasks
Official title: SCH: AI-Powered Video-Based Task Assistance for Blind and Low Vision Learners
Funded at Northeastern University · NIH-11579074 · Data updated 2026-11-12
A hospital-style grant is funding a wearable glasses system that gives BLV individuals real-time, step-by-step video instructions to do everyday tasks.
Quick facts
| Grant type | R01 grant |
|---|---|
| Study type | NIH-funded research |
| Funding institution | Northeastern University NIH-funded |
| Lab location | 1 site (Boston, United States) |
| Project start | September 30, 2026 |
| Project end | September 29, 2030 |
| Funding year | 2026 |
| Award (this year) | $898,334 |
| NIH project number | 1R01EY040335-01 |
| Project ID | NIH-11579074 on NIH RePORTER |
Who could benefit from this research
✓Could help
Ideal candidates are adults with blindness or severe vision impairment who rely on non-visual strategies for ADLs and can use wearable smartglasses.
✕Less likely to help
Individuals who do not use or cannot tolerate wearable glasses or who have conditions affecting safety during task performance may receive limited benefit.
What this research studies
This project aims to help people who are blind or have low vision perform daily activities more independently by using smart glasses that provide personalized video guidance. Researchers will build models of expert instruction and embed them into a wearable system called TaskPilot to deliver visual and non-visual cues during tasks. The work spans computer vision, human-computer interaction, and rehabilitation technology, with three main goals: create a dataset and benchmark for procedural tasks, implement real-time guidance, and evaluate usability and impact on independence. The approach is designed to expand access to practical ADL support for BLV individuals who currently have limited access to trained therapists.
Why it matters
Potential benefit: If successful, BLV individuals could complete daily tasks more independently, improving health, safety, and quality of life.
How similar studies have gone: Prior efforts show promise in assistive technology but real-time, personalized video guidance for BLV ADLs remains an emerging area.
Where this research is happening
-
Northeastern University
Boston, United States Active
Researchers
- Principal investigator: Torresani, Lorenzo — Northeastern University
- Study coordinator: Torresani, Lorenzo
About this research
- This is an active NIH-funded research project — typically early-stage science, not a clinical trial accepting patient enrollment.
- Some NIH-funded labs run parallel clinical studies or seek volunteers for related work. To check, contact the principal investigator or institution listed above.
- For full project details, budget, and progress reports, visit the official NIH RePORTER page.