Abstract
Scalar variables, e.g., the orientation of a shape in an image, are commonlypredicted using a single output neuron in a neural network. In contrast, themammalian cortex represents variables with a population of neurons. In thispopulation code, each neuron is most active at its preferred value and showspartial activity for other values. Here, we investigate the benefit of using apopulation code for the output layer of a neural network. We compare populationcodes against single-neuron outputs and one-hot vectors. First, we showtheoretically and in experiments with synthetic data that population codesimprove robustness to input noise in networks of stacked linear layers. Second,we demonstrate the benefit of using population codes to encode ambiguousoutputs, such as the pose of symmetric objects. Using the T-LESS dataset offeature-less real-world objects, we show that population codes improve theaccuracy of predicting 3D object orientation from image input.