A New Paradigm in Tuning Learned Indexes: A Reinforcement Learning Enhanced Approach

  • 2025-02-07 15:22:15
  • Taiyi Wang, Liang Liang, Guang Yang, Thomas Heinis, Eiko Yoneki
  • 0

Abstract

Learned Index Structures (LIS) have significantly advanced data management byleveraging machine learning models to optimize data indexing. However,designing these structures often involves critical trade-offs, making itchallenging for both designers and end-users to find an optimal balancetailored to specific workloads and scenarios. While some indexes offeradjustable parameters that demand intensive manual tuning, others rely on fixedconfigurations based on heuristic auto-tuners or expert knowledge, which maynot consistently deliver optimal performance. This paper introduces LITune, a novel framework for end-to-end automatictuning of Learned Index Structures. LITune employs an adaptive trainingpipeline equipped with a tailor-made Deep Reinforcement Learning (DRL) approachto ensure stable and efficient tuning. To accommodate long-term dynamicsarising from online tuning, we further enhance LITune with an on-the-flyupdating mechanism termed the O2 system. These innovations allow LITune toeffectively capture state transitions in online tuning scenarios anddynamically adjust to changing data distributions and workloads, marking asignificant improvement over other tuning methods. Our experimental resultsdemonstrate that LITune achieves up to a 98% reduction in runtime and a 17-foldincrease in throughput compared to default parameter settings given a selectedLearned Index instance. These findings highlight LITune's effectiveness and itspotential to facilitate broader adoption of LIS in real-world applications.

 

Quick Read (beta)

loading the full paper ...