A Survey of Deep Learning for Scientific Discovery

  • 2020-03-26 06:16:08
  • Maithra Raghu, Eric Schmidt
  • 202

Abstract

Over the past few years, we have seen fundamental breakthroughs in coreproblems in machine learning, largely driven by advances in deep neuralnetworks. At the same time, the amount of data collected in a wide array ofscientific domains is dramatically increasing in both size and complexity.Taken together, this suggests many exciting opportunities for deep learningapplications in scientific settings. But a significant challenge to this issimply knowing where to start. The sheer breadth and diversity of differentdeep learning techniques makes it difficult to determine what scientificproblems might be most amenable to these methods, or which specific combinationof methods might offer the most promising first approach. In this survey, wefocus on addressing this central issue, providing an overview of many widelyused deep learning models, spanning visual, sequential and graph structureddata, associated tasks and different training methods, along with techniques touse deep learning with less data and better interpret these complex models ---two central considerations for many scientific use cases. We also includeoverviews of the full design process, implementation tips, and links to aplethora of tutorials, research summaries and open-sourced deep learningpipelines and pretrained models, developed by the community. We hope that thissurvey will help accelerate the use of deep learning across differentscientific domains.

 

Quick Read (beta)

loading the full paper ...