Abstract
Discovering efficient algorithms for solving complex problems has been anoutstanding challenge in mathematics and computer science, requiringsubstantial human expertise over the years. Recent advancements in evolutionarysearch with large language models (LLMs) have shown promise in accelerating thediscovery of algorithms across various domains, particularly in mathematics andoptimization. However, existing approaches treat the LLM as a static generator,missing the opportunity to update the model with the signal obtained fromevolutionary exploration. In this work, we propose to augment LLM-basedevolutionary search by continuously refining the search operator - the LLM -through reinforcement learning (RL) fine-tuning. Our method leveragesevolutionary search as an exploration strategy to discover improved algorithms,while RL optimizes the LLM policy based on these discoveries. Our experimentson combinatorial optimization tasks demonstrate that integrating RL withevolutionary search accelerates the discovery of superior algorithms,showcasing the potential of RL-enhanced evolutionary strategies for algorithmdesign.