Revealing interpretable object representations from human behavior

  • 2019-01-09 20:04:42
  • Charles Y. Zheng, Francisco Pereira, Chris I. Baker, Martin N. Hebart
  • 23

Abstract

To study how mental object representations are related to behavior, weestimated sparse, non-negative representations of objects using humanbehavioral judgments on images representative of 1,854 object categories. Theserepresentations predicted a latent similarity structure between objects, whichcaptured most of the explainable variance in human behavioral judgments.Individual dimensions in the low-dimensional embedding were found to be highlyreproducible and interpretable as conveying degrees of taxonomic membership,functionality, and perceptual attributes. We further demonstrated thepredictive power of the embeddings for explaining other forms of humanbehavior, including categorization, typicality judgments, and feature ratings,suggesting that the dimensions reflect human conceptual representations ofobjects beyond the specific task.

 

Quick Read (beta)

loading the full paper ...