Abstract
With technological advances leading to an increase in mechanisms for imagetampering, fraud detection methods must continue to be upgraded to match theirsophistication. One problem with current methods is that they require priorknowledge of the method of forgery in order to determine which features toextract from the image to localize the region of interest. When a machinelearning algorithm is used to learn different types of tampering from a largeset of various image types, with a large enough database we can easily classifywhich images are tampered (by training on the entire image feature map for eachimage). However, we still are left with the question of which features to trainon, and how to localize the manipulation. To solve this, object detectionnetworks such as Faster R-CNN, which combine an RPN (Region Proposal Network)with a CNN, have recently been adapted to fraud detection by utilizing theirability to propose bounding boxes for objects of interest to localize thetampering artifacts. By making use of the computational powers of today's GPUsthis method also achieves a fast run-time and higher accuracy than the topcurrent methods such as noise analysis, ELA (Error Level Analysis), or CFA(Color Filter Array). In this work, a multi-linear Faster RCNN network will beapplied similarly but with the second stream having an input of the ELA JPEGcompression level mask. This is shown to provide even higher accuracy by addingtraining features from the segmented image map to the network.