GECO: Geometrically Consistent Embedding with Lightspeed Inference

  • 2025-08-01 16:21:11
  • Regine Hartwig, Dominik Muhle, Riccardo Marin, Daniel Cremers
  • 0

Abstract

Recent advances in feature learning have shown that self-supervised visionfoundation models can capture semantic correspondences but often lack awarenessof underlying 3D geometry. GECO addresses this gap by producing geometricallycoherent features that semantically distinguish parts based on geometry (e.g.,left/right eyes, front/back legs). We propose a training framework based onoptimal transport, enabling supervision beyond keypoints, even under occlusionsand disocclusions. With a lightweight architecture, GECO runs at 30 fps, 98.2%faster than prior methods, while achieving state-of-the-art performance onPFPascal, APK, and CUB, improving PCK by 6.0%, 6.2%, and 4.1%, respectively.Finally, we show that PCK alone is insufficient to capture geometric qualityand introduce new metrics and insights for more geometry-aware featurelearning. Link to project page:https://reginehartwig.github.io/publications/geco/

 

Quick Read (beta)

loading the full paper ...