Abstract
Accurately determining the shape of objects and the location of theirinternal structures within deformable objects is crucial for medical tasks thatrequire precise targeting, such as robotic biopsies. We introduce LUDO, amethod for accurate low-latency understanding of deformable objects. LUDOreconstructs objects in their deformed state, including their internalstructures, from a single-view point cloud observation in under 30 ms usingoccupancy networks. LUDO provides uncertainty estimates for its predictions.Additionally, it provides explainability by highlighting key features in itsinput observations. Both uncertainty and explainability are important forsafety-critical applications such as surgical interventions. We demonstrateLUDO's abilities for autonomous targeting of internal regions of interest(ROIs) in deformable objects. %Additionally, LUDO provides uncertaintyestimates and explainability for its predictions, both of which are importantin safety-critical applications such as surgical interventions. We evaluateLUDO in real-world robotic experiments, achieving a success rate of 98.9% forpuncturing various ROIs inside deformable objects. LUDO demonstrates thepotential to interact with deformable objects without the need for deformableregistration methods.