Abstract
Online learning represents an important family of machine learningalgorithms, in which a learner attempts to resolve an online prediction (or anytype of decision-making) task by learning a model/hypothesis from a sequence ofdata instances one at a time. The goal of online learning is to ensure that theonline learner would make a sequence of accurate predictions (or correctdecisions) given the knowledge of correct answers to previous prediction orlearning tasks and possibly additional information. This is in contrast to manytraditional batch learning or offline machine learning algorithms that areoften designed to train a model in batch from a given collection of trainingdata instances. This survey aims to provide a comprehensive survey of theonline machine learning literatures through a systematic review of basic ideasand key principles and a proper categorization of different algorithms andtechniques. Generally speaking, according to the learning type and the forms offeedback information, the existing online learning works can be classified intothree major categories: (i) supervised online learning where full feedbackinformation is always available, (ii) online learning with limited feedback,and (iii) unsupervised online learning where there is no feedback available.Due to space limitation, the survey will be mainly focused on the firstcategory, but also briefly cover some basics of the other two categories.Finally, we also discuss some open issues and attempt to shed light onpotential future research directions in this field.