Abstract

A novel gradient boosting framework is proposed where shallow neural networksare employed as "weak learners". General loss functions are considered underthis unified framework with specific examples presented for classification,regression and learning to rank. A fully corrective step is incorporated toremedy the pitfall of greedy function approximation of classic gradientboosting decision tree. The proposed model rendered state-of-the-art results inall three tasks on multiple datasets. An ablation study is performed to shedlight on the effect of each model components and model hyperparameters.

 

Quick Read (beta)