Community Forensics: Using Thousands of Generators to Train Fake Image Detectors

  • 2024-11-06 18:59:41
  • Jeongsoo Park, Andrew Owens
  • 0

Abstract

One of the key challenges of detecting AI-generated images is spotting imagesthat have been created by previously unseen generative models. We argue thatthe limited diversity of the training data is a major obstacle to addressingthis problem, and we propose a new dataset that is significantly larger andmore diverse than prior work. As part of creating this dataset, wesystematically download thousands of text-to-image latent diffusion models andsample images from them. We also collect images from dozens of popular opensource and commercial models. The resulting dataset contains 2.7M images thathave been sampled from 4803 different models. These images collectively capturea wide range of scene content, generator architectures, and image processingsettings. Using this dataset, we study the generalization abilities of fakeimage detectors. Our experiments suggest that detection performance improves asthe number of models in the training set increases, even when these models havesimilar architectures. We also find that detection performance improves as thediversity of the models increases, and that our trained detectors generalizebetter than those trained on other datasets.

 

Quick Read (beta)

loading the full paper ...