Deep learning languages: a key fundamental shift from probabilities to weights?

  • 2019-08-02 10:09:51
  • François Coste
  • 8

Abstract

Recent successes in language modeling, notably with deep learning methods,coincide with a shift from probabilistic to weighted representations. We raisehere the question of the importance of this evolution, in the light of thepractical limitations of a classical and simple probabilistic modeling approachfor the classification of protein sequences and in relation to the need forprincipled methods to learn non-probabilistic models.

 

Quick Read (beta)

loading the full paper ...