Abstract

In many scenarios of a language identification task, the user will specify asmall set of languages which he/she can speak instead of a large set of allpossible languages. We want to model such prior knowledge into the way we trainour neural networks, by replacing the commonly used softmax loss function witha novel loss function named tuplemax loss. As a matter of fact, a typicallanguage identification system launched in North America has about 95% userswho could speak no more than two languages. Using the tuplemax loss, our systemachieved a 2.33% error rate, which is a relative 39.4% improvement over the3.85% error rate of standard softmax loss method.

 

Quick Read (beta)