Abstract
Humans understand language based on the rich background knowledge about howthe physical world works, which in turn allows us to reason about the physicalworld through language. In addition to the properties of objects (e.g., boatsrequire fuel) and their affordances, i.e., the actions that are applicable tothem (e.g., boats can be driven), we can also reason about if-then inferencesbetween what properties of objects imply the kind of actions that areapplicable to them (e.g., that if we can drive something then it likelyrequires fuel). In this paper, we investigate the extent to which state-of-the-art neurallanguage representations, trained on a vast amount of natural language text,demonstrate physical commonsense reasoning. While recent advancements of neurallanguage models have demonstrated strong performance on various types ofnatural language inference tasks, our study based on a dataset of over 200knewly collected annotations suggests that neural language representations stillonly learn associations that are explicitly written down.