Statistical Properties of Deep Neural Networks with Dependent Data

  • 2024-11-05 18:26:53
  • Chad Brown
  • 0

Abstract

This paper establishes statistical properties of deep neural network (DNN)estimators under dependent data. Two general results for nonparametric sieveestimators directly applicable to DNN estimators are given. The firstestablishes rates for convergence in probability under nonstationary data. Thesecond provides non-asymptotic probability bounds on $\mathcal{L}^{2}$-errorsunder stationary $\beta$-mixing data. I apply these results to DNN estimatorsin both regression and classification contexts imposing only a standardH\"older smoothness assumption. The DNN architectures considered are common inapplications, featuring fully connected feedforward networks with anycontinuous piecewise linear activation function, unbounded weights, and a widthand depth that grows with sample size. The framework provided also offerspotential for research into other DNN architectures and time-seriesapplications.

 

Quick Read (beta)

loading the full paper ...