Language Modeling with Reduced Densities

  • 2020-07-08 00:41:53
  • Tai-Danae Bradley, Yiannis Vlassopoulos
  • 50

Abstract

We present a framework for modeling words, phrases, and longer expressions ina natural language using reduced density operators. We show these operatorscapture something of the meaning of these expressions and, under the Loewnerorder on positive semidefinite operators, preserve both a simple form ofentailment and the relevant statistics therein. Pulling back the curtain, theassignment is shown to be a functor between categories enriched overprobabilities.

 

Quick Read (beta)

loading the full paper ...