What does it mean to understand a neural network?

  • 2019-07-15 08:58:26
  • Timothy P. Lillicrap, Konrad P. Kording
  • 377

Abstract

We can define a neural network that can learn to recognize objects in lessthan 100 lines of code. However, after training, it is characterized bymillions of weights that contain the knowledge about many object types acrossvisual scenes. Such networks are thus dramatically easier to understand interms of the code that makes them than the resulting properties, such as tuningor connections. In analogy, we conjecture that rules for development andlearning in brains may be far easier to understand than their resultingproperties. The analogy suggests that neuroscience would benefit from a focuson learning and development.

 

Quick Read (beta)

loading the full paper ...