Abstract
Recently, due to the popularity of deep neural networks and other methodswhose training typically relies on the optimization of an objective function,and due to concerns for data privacy, there is a lot of interest indifferentially private gradient descent methods. To achieve differentialprivacy guarantees with a minimum amount of noise, it is important to be ableto bound precisely the sensitivity of the information which the participantswill observe. In this study, we present a novel approach that mitigates thebias arising from traditional gradient clipping. By leveraging publicinformation concerning the current global model and its location within thesearch domain, we can achieve improved gradient bounds, leading to enhancedsensitivity determinations and refined noise level adjustments. We extend thestate of the art algorithms, present improved differential privacy guaranteesrequiring less noise and present an empirical evaluation.