Abstract

Hyperparameter plays an essential role in the fitting of supervised machinelearning algorithms. However, it is computationally expensive to tune all thetunable hyperparameters simultaneously especially for large data sets. In thispaper, we give a definition of hyperparameter importance that can be estimatedby subsampling procedures. According to the importance, hyperparameters canthen be tuned on the entire data set more efficiently. We show theoreticallythat the proposed importance on subsets of data is consistent with the one onthe population data under weak conditions. Numerical experiments show that theproposed importance is consistent and can save a lot of computationalresources.

 

Quick Read (beta)