Abstract
The visual anonymisation of sign language data is an essential task toaddress privacy concerns raised by large-scale dataset collection. Previousanonymisation techniques have either significantly affected sign comprehensionor required manual, labour-intensive work. In this paper, we formally introduce the task of Sign Language VideoAnonymisation (SLVA) as an automatic method to anonymise the visual appearanceof a sign language video whilst retaining the meaning of the original signlanguage sequence. To tackle SLVA, we propose AnonySign, a novel automaticapproach for visual anonymisation of sign language data. We first extract poseinformation from the source video to remove the original signer appearance. Wenext generate a photo-realistic sign language video of a novel appearance fromthe pose sequence, using image-to-image translation methods in a conditionalvariational autoencoder framework. An approximate posterior style distributionis learnt, which can be sampled from to synthesise novel human appearances. Inaddition, we propose a novel \textit{style loss} that ensures style consistencyin the anonymised sign language videos. We evaluate AnonySign for the SLVA task with extensive quantitative andqualitative experiments highlighting both realism and anonymity of our novelhuman appearance synthesis. In addition, we formalise an anonymity perceptualstudy as an evaluation criteria for the SLVA task and showcase that videoanonymisation using AnonySign retains the original sign language content.