Enhanced Vision Assistance: Leveraging AI in Lookout

Date & Time

Thursday, March 21, 2024 - 9:20 AM PDT  

Location

Grand AB  

Description

Lookout is an assisted vision tool that helps people with low-vision and blindness navigate the world around them. The app uses a combination of artificial intelligence and augmented reality to identify objects, text, and even people in the user's field of view. Lookout has successfully helped its users live more independent lives. - This talk will provide an overview of existing and newly launched features in Lookout and demonstrate how the app can be leveraged to help blind and low-vision users complete tasks as efficiently as possible. - We will also dive deeper into how we leverage LLM models to help users get a better context on images through auto-generated captions and interactive Q&A that would greatly enhance their experience of photos that they might encounter visual limitations to otherwise see. - Further, we will discuss what's next for Lookout and how we plan to continue expanding our impact and reach to visually impaired users by investing in new technologies and listening to our users.  

Audience

• Information & Communications Technology
• Disability Specific
• Research & Development

Audience Level

Intermediate  

Session Summary (Abstract)

Lookout is an Android app that uses vision AI and your phone’s camera to help people with vision impairments read text, recognize objects and understand images.
We will discuss new features we launched and how we leveraged AI and AR technologies.  

Primary Topic

Blind/Low Vision  

Secondary Topics

Artificial Intelligence (AI) & Machine Learning (ML)  

Session Type

General Track  

Presenter

• Sejal D'Souza
  Google

Add to Outlook/iCal (How it works)

Back to Session List