A 'Point and Listen' Tool for People with Vision Loss
Point and Listen: Augmented Reality Interfaces for the Visually Impaired
This project is creating a new smartphone and wearable app that helps people who are blind or visually impaired 'hear' information about objects they point to.
Quick facts
| Grant type | R01 grant |
|---|---|
| Study type | NIH-funded research |
| Funding institution | Smith-Kettlewell Eye Research Institute NIH-funded |
| Lab location | 1 site (San Francisco, United States) |
| Project ID | NIH-11046532 on NIH RePORTER |
What this research studies
This project is developing an app called CamIO, which uses augmented reality to help people with vision loss understand physical objects around them. By simply pointing your smartphone or a special wearable camera at an object like a document or a map, the app will speak aloud information about what you are pointing to. This technology allows you to explore objects naturally with your fingers and hear details, without needing special braille labels or modified items. The goal is to make everyday items more accessible and easier to interact with for those who are blind or have low vision.
Who could benefit from this research
Good fit: Ideal candidates for this technology would be individuals who are blind or visually impaired and are interested in using smartphone or wearable camera technology to interact with their environment.
Not a fit: Patients who are not comfortable with or unable to use smartphone or wearable camera devices may not receive direct benefit from this specific technology.
Why it matters
Potential benefit: If successful, this technology could significantly improve daily independence and access to information for people who are blind or visually impaired.
How similar studies have performed: While augmented reality for vision assistance is an evolving field, this project builds on existing prototype app work and aims to introduce novel enhancements like finger tracking and wearable camera support.
Where this research is happening
San Francisco, United States
- Smith-Kettlewell Eye Research Institute — San Francisco, United States (Active)
Researchers
- Principal investigator: Coughlan, James M — Smith-Kettlewell Eye Research Institute
- Study coordinator: Coughlan, James M
About this research
- This is an active NIH-funded research project — typically early-stage science, not a clinical trial accepting patient enrollment.
- Some NIH-funded labs run parallel clinical studies or seek volunteers for related work. To check, contact the principal investigator or institution listed above.
- For full project details, budget, and progress reports, visit the official NIH RePORTER page below.