Abstract
We propose a novel reinforcement learning-based approach for adaptive anditerative feature selection. Given a masked vector of input features, areinforcement learning agent iteratively selects certain features to beunmasked, and uses them to predict an outcome when it is sufficientlyconfident. The algorithm makes use of a novel environment setting,corresponding to a non-stationary Markov Decision Process. A key component ofour approach is a guesser network, trained to predict the outcome from theselected features and parametrizing the reward function. Applying our method toa national survey dataset, we show that it not only outperforms strongbaselines when requiring the prediction to be made based on a small number ofinput features, but is also highly more interpretable. Our code is publiclyavailable at \url{https://github.com/ushaham/adaptiveFS}.