Finding Fuzziness in Neural Network Models of Language Processing

  • 2021-04-22 01:06:14
  • Kanishka Misra, Julia Taylor Rayz
  • 6

Abstract

Humans often communicate by using imprecise language, suggesting that fuzzyconcepts with unclear boundaries are prevalent in language use. In this paper,we test the extent to which models trained to capture the distributionalstatistics of language show correspondence to fuzzy-membership patterns. Usingthe task of natural language inference, we test a recent state of the art modelon the classical case of temperature, by examining its mapping of temperaturedata to fuzzy-perceptions such as "cool", "hot", etc. We find the model to showpatterns that are similar to classical fuzzy-set theoretic formulations oflinguistic hedges, albeit with a substantial amount of noise, suggesting thatmodels trained solely on language show promise in encoding fuzziness.

 

Quick Read (beta)

loading the full paper ...