Effects of language mismatch in automatic forensic voice comparison using deep learning embeddings

  • 2022-09-26 12:49:37
  • Dávid Sztahó, Attila Fejes
  • 0

Abstract

In forensic voice comparison the speaker embedding has become widely popularin the last 10 years. Most of the pretrained speaker embeddings are trained onEnglish corpora, because it is easily accessible. Thus, language dependency canbe an important factor in automatic forensic voice comparison, especially whenthe target language is linguistically very different. There are numerouscommercial systems available, but their models are mainly trained on adifferent language (mostly English) than the target language. In the case of alow-resource language, developing a corpus for forensic purposes containingenough speakers to train deep learning models is costly. This study aims toinvestigate whether a model pre-trained on English corpus can be used on atarget low-resource language (here, Hungarian), different from the model istrained on. Also, often multiple samples are not available from the offender(unknown speaker). Therefore, samples are compared pairwise with and withoutspeaker enrollment for suspect (known) speakers. Two corpora are applied thatwere developed especially for forensic purposes, and a third that is meant fortraditional speaker verification. Two deep learning based speaker embeddingvector extraction methods are used: the x-vector and ECAPA-TDNN. Speakerverification was evaluated in the likelihood-ratio framework. A comparison ismade between the language combinations (modeling, LR calibration, evaluation).The results were evaluated by minCllr and EER metrics. It was found that themodel pre-trained on a different language but on a corpus with a huge amount ofspeakers performs well on samples with language mismatch. The effect of sampledurations and speaking styles were also examined. It was found that the longerthe duration of the sample in question the better the performance is. Also,there is no real difference if various speaking styles are applied.

 

Quick Read (beta)

loading the full paper ...