Can Uncertainty Quantification Improve Learned Index Benefit Estimation?

  • 2025-09-02 06:14:14
  • Tao Yu, Zhaonian Zou, Hao Xiong
  • 0

Abstract

Index tuning is crucial for optimizing database performance by selectingoptimal indexes based on workload. The key to this process lies in an accurateand efficient benefit estimator. Traditional methods relying on what-if toolsoften suffer from inefficiency and inaccuracy. In contrast, learning-basedmodels provide a promising alternative but face challenges such as instability,lack of interpretability, and complex management. To overcome theselimitations, we adopt a novel approach: quantifying the uncertainty inlearning-based models' results, thereby combining the strengths of bothtraditional and learning-based methods for reliable index tuning. We propose Beauty, the first uncertainty-aware framework that enhanceslearning-based models with uncertainty quantification and uses what-if tools asa complementary mechanism to improve reliability and reduce managementcomplexity. Specifically, we introduce a novel method that combines AutoEncoderand Monte Carlo Dropout to jointly quantify uncertainty, tailored to thecharacteristics of benefit estimation tasks. In experiments involving sixteen models, our approach outperformed existinguncertainty quantification methods in the majority of cases. We also conductedindex tuning tests on six datasets. By applying the Beauty framework, weeliminated worst-case scenarios and more than tripled the occurrence ofbest-case scenarios.

 

Quick Read (beta)

loading the full paper ...