Abstract
Designing residential interiors strongly impacts occupant satisfaction butremains challenging due to unstructured spatial layouts, high computationaldemands, and reliance on expert knowledge. Existing methods based onoptimization or deep learning are either computationally expensive orconstrained by data scarcity. Reinforcement learning (RL) approaches oftenlimit furniture placement to discrete positions and fail to incorporate designprinciples adequately. We propose OID-PPO, a novel RL framework for OptimalInterior Design using Proximal Policy Optimization, which integratesexpert-defined functional and visual guidelines into a structured rewardfunction. OID-PPO utilizes a diagonal Gaussian policy for continuous andflexible furniture placement, effectively exploring latent environmentaldynamics under partial observability. Experiments conducted across diverse roomshapes and furniture configurations demonstrate that OID-PPO significantlyoutperforms state-of-the-art methods in terms of layout quality andcomputational efficiency. Ablation studies further demonstrate the impact ofstructured guideline integration and reveal the distinct contributions ofindividual design constraints.