Abstract
We tackle the problem of robust novelty detection, where we aim to detectnovelties in terms of semantic content while being invariant to changes inother, irrelevant factors. Specifically, we operate in a setup with multipleenvironments, where we determine the set of features that are associated morewith the environments, rather than to the content relevant for the task. Thus,we propose a method that starts with a pretrained embedding and a multi-envsetup and manages to rank the features based on their environment-focus. First,we compute a per-feature score based on the feature distribution variancebetween envs. Next, we show that by dropping the highly scored ones, we manageto remove spurious correlations and improve the overall performance by up to6%, both in covariance and sub-population shift cases, both for a real and asynthetic benchmark, that we introduce for this task.