Abstract
In this paper, we propose "personal VAD", a system to detect the voiceactivity of a target speaker at the frame level. This system is useful forgating the inputs to a streaming speech recognition system, such that it onlytriggers for the target user, which helps reduce the computational cost andbattery consumption. We achieve this by training a VAD-alike neural networkthat is conditioned on the target speaker embedding or the speaker verificationscore. For every frame, personal VAD outputs the scores for three classes:non-speech, target speaker speech, and non-target speaker speech. With ouroptimal setup, we are able to train a 130KB model that outperforms a baselinesystem where individually trained standard VAD and speaker recognition networkare combined to perform the same task.