Abstract
We derive the optimal differential privacy (DP) parameters of a mechanismthat satisfies a given level of R\'enyi differential privacy (RDP). Our resultis based on the joint range of two $f$-divergences that underlie theapproximate and the R\'enyi variations of differential privacy. We apply ourresult to the moments accountant framework for characterizing privacyguarantees of stochastic gradient descent. When compared to thestate-of-the-art, our bounds may lead to about 100 more stochastic gradientdescent iterations for training deep learning models for the same privacybudget.
Quick Read (beta)
loading the full paper ...