High-Quality Prediction Intervals for Deep Learning: A Distribution-Free, Ensembled Approach

  • 2018-06-12 15:58:44
  • Tim Pearce, Mohamed Zaki, Alexandra Brintrup, Andy Neely
  • 0

Abstract

This paper considers the generation of prediction intervals (PIs) by neuralnetworks for quantifying uncertainty in regression tasks. It is axiomatic thathigh-quality PIs should be as narrow as possible, whilst capturing a specifiedportion of data. We derive a loss function directly from this axiom thatrequires no distributional assumption. We show how its form derives from alikelihood principle, that it can be used with gradient descent, and that modeluncertainty is accounted for in ensembled form. Benchmark experiments show themethod outperforms current state-of-the-art uncertainty quantification methods,reducing average PI width by over 10%.

 

Quick Read (beta)

loading the full paper ...