In standard generative adversarial network (SGAN), the discriminatorestimates the probability that the input data is real. The generator is trainedto increase the probability that fake data is real. We argue that it shouldalso simultaneously decrease the probability that real data is real because 1)this would account for a priori knowledge that half of the data in themini-batch is fake, 2) this would be observed with divergence minimization, and3) in optimal settings, SGAN would be equivalent to integral probability metric(IPM) GANs. We show that this property can be induced by using a relativisticdiscriminator which estimate the probability that the given real data is morerealistic than a randomly sampled fake data. We also present a variant in whichthe discriminator estimate the probability that the given real data is morerealistic than fake data, on average. We generalize both approaches tonon-standard GAN loss functions and we refer to them respectively asRelativistic GANs (RGANs) and Relativistic average GANs (RaGANs). We show thatIPM-based GANs are a subset of RGANs which use the identity function. Empirically, we observe that 1) RGANs and RaGANs are significantly morestable and generate higher quality data samples than their non-relativisticcounterparts, 2) Standard RaGAN with gradient penalty generate data of betterquality than WGAN-GP while only requiring a single discriminator update pergenerator update (reducing the time taken for reaching the state-of-the-art by400%), and 3) RaGANs are able to generate plausible high resolutions images(256x256) from a very small sample (N=2011), while GAN and LSGAN cannot; theseimages are of significantly better quality than the ones generated by WGAN-GPand SGAN with spectral normalization.