Abstract
Generative Flow Networks (GFlowNets or GFNs) are probabilistic modelspredicated on Markov flows, and they employ specific amortization algorithms tolearn stochastic policies that generate compositional substances includingbiomolecules, chemical materials, etc. With a strong ability to generatehigh-performance biochemical molecules, GFNs accelerate the discovery ofscientific substances, effectively overcoming the time-consuming,labor-intensive, and costly shortcomings of conventional material discoverymethods. However, previous studies rarely focus on accumulating exploratoryexperience by adjusting generative structures, which leads to disorientation incomplex sampling spaces. Efforts to address this issue, such as LS-GFN, arelimited to local greedy searches and lack broader global adjustments. Thispaper introduces a novel variant of GFNs, the Dynamic Backtracking GFN(DB-GFN), which improves the adaptability of decision-making steps through areward-based dynamic backtracking mechanism. DB-GFN allows backtracking duringthe network construction process according to the current state's reward value,thereby correcting disadvantageous decisions and exploring alternative pathwaysduring the exploration process. When applied to generative tasks involvingbiochemical molecules and genetic material sequences, DB-GFN outperforms GFNmodels such as LS-GFN and GTB, as well as traditional reinforcement learningmethods, in sample quality, sample exploration quantity, and trainingconvergence speed. Additionally, owing to its orthogonal nature, DB-GFN showsgreat potential in future improvements of GFNs, and it can be integrated withother strategies to achieve higher search performance.