Abstract

We propose a new method for input variable selection in nonlinear regression.The method is embedded into a kernel regression machine that can model generalnonlinear functions, not being a priori limited to additive models. This is thefirst kernel-based variable selection method applicable to large datasets. Itsidesteps the typical poor scaling properties of kernel methods by mapping theinputs into a relatively low-dimensional space of random features. Thealgorithm discovers the variables relevant for the regression task togetherwith learning the prediction model through learning the appropriate nonlinearrandom feature maps. We demonstrate the outstanding performance of our methodon a set of large-scale synthetic and real datasets.

 

Quick Read (beta)