Empowering Visually Impaired Individuals: A Novel Use of Apple Live Photos and Android Motion Photos

  • 2023-09-14 21:46:35
  • Seyedalireza Khoshsirat, Chandra Kambhamettu
  • 0

Abstract

Numerous applications have been developed to assist visually impairedindividuals that employ a machine learning unit to process visual input.However, a critical challenge with these applications is the sub-optimalquality of images captured by the users. Given the complexity of operating acamera for visually impaired individuals, we advocate for the use of Apple LivePhotos and Android Motion Photos technologies. In this study, we introduce astraightforward methodology to evaluate and contrast the efficacy ofLive/Motion Photos against traditional image-based approaches. Our findingsreveal that both Live Photos and Motion Photos outperform single-frame imagesin common visual assisting tasks, specifically in object classification andVideoQA. We validate our results through extensive experiments on the ORBITdataset, which consists of videos collected by visually impaired individuals.Furthermore, we conduct a series of ablation studies to delve deeper into theimpact of deblurring and longer temporal crops.

 

Quick Read (beta)

loading the full paper ...