Abstract
Optical communication using modulated LEDs (e.g., visible lightcommunication) is an emerging application for event cameras, thanks to theirhigh spatio-temporal resolutions. Event cameras can be used simply to decodethe LED signals and also to localize the camera relative to the LED markerpositions. However, there is no public dataset to benchmark the decoding andlocalization in various real-world settings. We present, to the best of ourknowledge, the first public dataset that consists of an event camera, a framecamera, and ground-truth poses that are precisely synchronized with hardwaretriggers. It provides various camera motions with various sensitivities indifferent scene brightness settings, both indoor and outdoor. Furthermore, wepropose a novel method of localization that leverages the Contrast Maximizationframework for motion estimation and compensation. The detailed analysis andexperimental results demonstrate the advantages of LED-based localization withevents over the conventional AR-marker--based one with frames, as well as theefficacy of the proposed method in localization. We hope that the proposeddataset serves as a future benchmark for both motion-related classical computervision tasks and LED marker decoding tasks simultaneously, paving the way tobroadening applications of event cameras on mobile devices.https://woven-visionai.github.io/evlc-dataset