BIV-Priv-Seg: Locating Private Content in Images Taken by People With Visual Impairments

  • 2024-07-25 18:57:48
  • Yu-Yun Tseng, Tanusree Sharma, Lotus Zhang, Abigale Stangl, Leah Findlater, Yang Wang, Danna Gurari Yu-Yun Tseng, Tanusree Sharma, Lotus Zhang, Abigale Stangl, Leah Findlater, Yang Wang, Danna Gurari
  • 0

Abstract

Individuals who are blind or have low vision (BLV) are at a heightened riskof sharing private information if they share photographs they have taken. Tofacilitate developing technologies that can help preserve privacy, we introduceBIV-Priv-Seg, the first localization dataset originating from people withvisual impairments that shows private content. It contains 1,028 images withsegmentation annotations for 16 private object categories. We firstcharacterize BIV-Priv-Seg and then evaluate modern models' performance forlocating private content in the dataset. We find modern models struggle mostwith locating private objects that are not salient, small, and lack text aswell as recognizing when private content is absent from an image. We facilitatefuture extensions by sharing our new dataset with the evaluation server athttps://vizwiz.org/tasks-and-datasets/object-localization.

 

Quick Read (beta)

loading the full paper ...