Abstract
Recent research has highlighted the significance of natural language inenhancing the controllability of generative models. While various efforts havebeen made to leverage natural language for content generation, research on deepreinforcement learning (DRL) agents utilizing text-based instructions forprocedural content generation remains limited. In this paper, we proposeIPCGRL, an instruction-based procedural content generation method viareinforcement learning, which incorporates a sentence embedding model. IPCGRLfine-tunes task-specific embedding representations to effectively compressgame-level conditions. We evaluate IPCGRL in a two-dimensional level generationtask and compare its performance with a general-purpose embedding method. Theresults indicate that IPCGRL achieves up to a 21.4% improvement incontrollability and a 17.2% improvement in generalizability for unseeninstructions. Furthermore, the proposed method extends the modality ofconditional input, enabling a more flexible and expressive interactionframework for procedural content generation.