Asynchronous Spatial Image Convolutions for Event Cameras

  • 2019-02-08 16:37:57
  • Cedric Scheerlinck, Nick Barnes, Robert Mahony
  • 0


Spatial convolution is arguably the most fundamental of 2D image processingoperations. Conventional spatial image convolution can only be applied to aconventional image, that is, an array of pixel values (or similar imagerepresentation) that are associated with a single instant in time. Eventcameras have serial, asynchronous output with no natural notion of an imageframe, and each event arrives with a different timestamp. In this paper, wepropose a method to compute the convolution of a linear spatial kernel with theoutput of an event camera. The approach operates on the event stream output ofthe camera directly without synthesising pseudo-image frames as is common inthe literature. The key idea is the introduction of an internal state thatdirectly encodes the convolved image information, which is updatedasynchronously as each event arrives from the camera. The state can be read-offas-often-as and whenever required for use in higher level vision algorithms forreal-time robotic systems. We demonstrate the application of our method tocorner detection, providing an implementation of a Harris corner-response"state" that can be used in real-time for feature detection and tracking onrobotic systems.


Introduction (beta)



Conclusion (beta)