A Better Bound Gives a Hundred Rounds: Enhanced Privacy Guarantees via $f$-Divergences

  • 2020-01-16 18:45:05
  • Shahab Asoodeh, Jiachun Liao, Flavio P. Calmon, Oliver Kosut, Lalitha Sankar
  • 5

Abstract

We derive the optimal differential privacy (DP) parameters of a mechanismthat satisfies a given level of R\'enyi differential privacy (RDP). Our resultis based on the joint range of two $f$-divergences that underlie theapproximate and the R\'enyi variations of differential privacy. We apply ourresult to the moments accountant framework for characterizing privacyguarantees of stochastic gradient descent. When compared to thestate-of-the-art, our bounds may lead to about 100 more stochastic gradientdescent iterations for training deep learning models for the same privacybudget.

 

Quick Read (beta)

loading the full paper ...