Bayesian Subspace Hidden Markov Model for Acoustic Unit Discovery

  • 2019-07-02 14:35:26
  • Lucas Ondel, Hari Krishna Vydana, Lukáš Burget, Jan Černocký
  • 0

Abstract

This work tackles the problem of learning a set of language specific acousticunits from unlabeled speech recordings given a set of labeled recordings fromother languages. Our approach may be described by the following two stepsprocedure: first the model learns the notion of acoustic units from thelabelled data and then the model uses its knowledge to find new acoustic unitson the target language. We implement this process with the Bayesian SubspaceHidden Markov Model (SHMM), a model akin to the Subspace Gaussian Mixture Model(SGMM) where each low dimensional embedding represents an acoustic unit ratherthan just a HMM's state. The subspace is trained on 3 languages from theGlobalPhone corpus (German, Polish and Spanish) and the AUs are discovered onthe TIMIT corpus. Results, measured in equivalent Phone Error Rate, show thatthis approach significantly outperforms previous HMM based acoustic unitsdiscovery systems and compares favorably with the Variational Auto Encoder-HMM.

 

Quick Read (beta)

loading the full paper ...