Abstract
Neutronic calculations for reactors are a daunting task when using MonteCarlo (MC) methods. As high-performance computing has advanced, the simulationof a reactor is nowadays more readily done, but design and optimization withmultiple parameters is still a computational challenge. MC transportsimulations, coupled with machine learning techniques, offer promising avenuesfor enhancing the efficiency and effectiveness of nuclear reactor optimization.This paper introduces a novel benchmark problem within the OpenNeoMC frameworkdesigned specifically for reinforcement learning. The benchmark involvesoptimizing a unit cell of a research reactor with two varying parameters (fueldensity and water spacing) to maximize neutron flux while maintaining reactorcriticality. The test case features distinct local optima, representingdifferent physical regimes, thus posing a challenge for learning algorithms.Through extensive simulations utilizing evolutionary and neuroevolutionaryalgorithms, we demonstrate the effectiveness of reinforcement learning innavigating complex optimization landscapes with strict constraints.Furthermore, we propose acceleration techniques within the OpenNeoMC framework,including model updating and cross-section usage by RAM utilization, toexpedite simulation times. Our findings emphasize the importance of machinelearning integration in reactor optimization and contribute to advancingmethodologies for addressing intricate optimization challenges in nuclearengineering. The sources of this work are available at our GitHub repository:https://github.com/Scientific-Computing-Lab-NRCN/RLOpenNeoMC