ImageEye: Batch Image Processing Using Program Synthesis

  • 2023-06-14 18:28:27
  • Celeste Barnaby, Qiaochu Chen, Roopsha Samanta, Isil Dillig
  • 0

Abstract

This paper presents a new synthesis-based approach for batch imageprocessing. Unlike existing tools that can only apply global edits to theentire image, our method can apply fine-grained edits to individual objectswithin the image. For example, our method can selectively blur or crop specificobjects that have a certain property. To facilitate such fine-grained imageediting tasks, we propose a neuro-symbolic domain-specific language (DSL) thatcombines pre-trained neural networks for image classification with otherlanguage constructs that enable symbolic reasoning. Our method canautomatically learn programs in this DSL from user demonstrations by utilizinga novel synthesis algorithm. We have implemented the proposed technique in atool called ImageEye and evaluated it on 50 image editing tasks. Our evaluationshows that ImageEye is able to automate 96% of these tasks.

 

Quick Read (beta)

loading the full paper ...