OptiHive: Ensemble Selection for LLM-Based Optimization via Statistical Modeling

  • 2025-08-04 15:11:51
  • Maxime Bouscary, Saurabh Amin
  • 0

Abstract

LLM-based solvers have emerged as a promising means of automating problemmodeling and solving. However, they remain unreliable and often depend oniterative repair loops that result in significant latency. We introduceOptiHive, an LLM-based framework that produces high-quality solvers foroptimization problems from natural-language descriptions without iterativeself-correction. OptiHive uses a single batched LLM query to generate diversecomponents (solvers, problem instances, and validation tests) and filters outerroneous components to ensure fully interpretable outputs. Taking into accountthe imperfection of the generated components, we employ a statistical model toinfer their true performance, enabling principled uncertainty quantificationand solver selection. On tasks ranging from traditional optimization problemsto challenging variants of the Multi-Depot Vehicle Routing Problem, OptiHivesignificantly outperforms baselines, increasing the optimality rate from 5\% to92\% on the most complex problems.

 

Quick Read (beta)

loading the full paper ...