This is an opinion paper about the strengths and weaknesses of Deep Nets.They are at the center of recent progress on Artificial Intelligence and are ofgrowing importance in Cognitive Science and Neuroscience since they enable thedevelopment of computational models that can deal with a large range ofvisually realistic stimuli and visual tasks. They have clear limitations butthey also have enormous successes. There is also gradual, though incomplete,understanding of their inner workings. It seems unlikely that Deep Nets intheir current form will be the best long-term solution either for buildinggeneral purpose intelligent machines or for understanding the mind/brain, butit is likely that many aspects of them will remain. At present Deep Nets dovery well on specific types of visual tasks and on specific benchmarkeddatasets. But Deep Nets are much less general purpose, flexible, and adaptivethan the human visual system. Moreover, methods like Deep Nets may run intofundamental difficulties when faced with the enormous complexity of naturalimages. To illustrate our main points, while keeping the references small, thispaper is slightly biased towards work from our group.