Abstract
While state-of-the-art contrastive Self-Supervised Learning (SSL) modelsproduce results competitive with their supervised counterparts, they lack theability to infer latent variables. In contrast, prescribed latent variable (LV)models enable attributing uncertainty, inducing task specific compression, andin general allow for more interpretable representations. In this work, weintroduce LV approximations to large scale contrastive SSL models. Wedemonstrate that this addition improves downstream performance (resulting in96.42% and 77.49% test top-1 fine-tuned performance on CIFAR10 and ImageNetrespectively with a ResNet50) as well as producing highly compressedrepresentations (588x reduction) that are useful for interpretability,classification and regression downstream tasks.