Abstract
Online conformal prediction enables the runtime calibration of a pre-trainedartificial intelligence model using feedback on its performance. Calibration isachieved through set predictions that are updated via online rules so as toensure long-term coverage guarantees. While recent research has demonstratedthe benefits of incorporating prior knowledge into the calibration process,this has come at the cost of replacing coverage guarantees with less tangibleregret guarantees based on the quantile loss. This work introduces intermittentmirror online conformal prediction (IM-OCP), a novel runtime calibrationframework that integrates prior knowledge, while maintaining long-term coverageand achieving sub-linear regret. IM-OCP features closed-form updates withminimal memory complexity, and is designed to operate under potentiallyintermittent feedback.