Abstract
Reinforcement Learning (RL) from raw visual input has achieved impressivesuccesses in recent years, yet it remains fragile to out-of-distributionvariations such as changes in lighting, color, and viewpoint. Point CloudReinforcement Learning (PC-RL) offers a promising alternative by mitigatingappearance-based brittleness, but its sensitivity to camera pose mismatchescontinues to undermine reliability in realistic settings. To address thischallenge, we propose PCA Point Cloud (PPC), a canonicalization frameworkspecifically tailored for downstream robotic control. PPC maps point cloudsunder arbitrary rigid-body transformations to a unique canonical pose, aligningobservations to a consistent frame, thereby substantially decreasingviewpoint-induced inconsistencies. In our experiments, we show that PPCimproves robustness to unseen camera poses across challenging robotic tasks,providing a principled alternative to domain randomization.