Abstract
Optimizing an unknown function under safety constraints is a central task inrobotics, biomedical engineering, and many other disciplines, and increasinglysafe Bayesian Optimization (BO) is used for this. Due to the safety criticalnature of these applications, it is of utmost importance that theoreticalsafety guarantees for these algorithms translate into the real world. In thiswork, we investigate three safety-related issues of the popular class ofSafeOpt-type algorithms. First, these algorithms critically rely on frequentistuncertainty bounds for Gaussian Process (GP) regression, but concreteimplementations typically utilize heuristics that invalidate all safetyguarantees. We provide a detailed analysis of this problem and introduceReal-\b{eta}-SafeOpt, a variant of the SafeOpt algorithm that leverages recentGP bounds and thus retains all theoretical guarantees. Second, we identifyassuming an upper bound on the reproducing kernel Hilbert space (RKHS) norm ofthe target function, a key technical assumption in SafeOpt-like algorithms, asa central obstacle to real-world usage. To overcome this challenge, weintroduce the Lipschitz-only Safe Bayesian Optimization (LoSBO) algorithm,which guarantees safety without an assumption on the RKHS bound, andempirically show that this algorithm is not only safe, but also exhibitssuperior performance compared to the state-of-the-art on several functionclasses. Third, SafeOpt and derived algorithms rely on a discrete search space,making them difficult to apply to higher-dimensional problems. To widen theapplicability of these algorithms, we introduce Lipschitz-only GP-UCB(LoS-GP-UCB), a variant of LoSBO applicable to moderately high-dimensionalproblems, while retaining safety.