Abstract
Recently, Meta-Black-Box-Optimization (MetaBBO) methods significantly enhancethe performance of traditional black-box optimizers through meta-learningflexible and generalizable meta-level policies that excel in dynamic algorithmconfiguration (DAC) tasks within the low-level optimization, reducing theexpertise required to adapt optimizers for novel optimization tasks. Thoughpromising, existing MetaBBO methods heavily rely on human-crafted featureextraction approach to secure learning effectiveness. To address this issue,this paper introduces a novel MetaBBO method that supports automated featurelearning during the meta-learning process, termed as RLDE-AFL, which integratesa learnable feature extraction module into a reinforcement learning-based DEmethod to learn both the feature encoding and meta-level policy. Specifically,we design an attention-based neural network with mantissa-exponent basedembedding to transform the solution populations and corresponding objectivevalues during the low-level optimization into expressive landscape features. Wefurther incorporate a comprehensive algorithm configuration space includingdiverse DE operators into a reinforcement learning-aided DAC paradigm tounleash the behavior diversity and performance of the proposed RLDE-AFL.Extensive benchmark results show that co-training the proposed feature learningmodule and DAC policy contributes to the superior optimization performance ofRLDE-AFL to several advanced DE methods and recent MetaBBO baselines over bothsynthetic and realistic BBO scenarios. The source codes of RLDE-AFL areavailable at https://github.com/GMC-DRL/RLDE-AFL.