Differential privacy is a de facto standard in data privacy, withapplications in the public and private sectors. A way to explain differentialprivacy, which is particularly appealing to statistician and social scientistsis by means of its statistical hypothesis testing interpretation. Informally,one cannot effectively test whether a specific individual has contributed herdata by observing the output of a private mechanism---any test cannot have bothhigh significance and high power. In this paper, we identify some conditions under which a privacy definitiongiven in terms of a statistical divergence satisfies a similar interpretation.These conditions are useful to analyze the distinguishability power ofdivergences and we use them to study the hypothesis testing interpretation ofsome relaxations of differential privacy based on Renyi divergence. Thisanalysis also results in an improved conversion rule between these definitionsand differential privacy.