Abstract
In recent years there has been a sharp rise in networking applications, inwhich significant events need to be classified but only a few traininginstances are available. These are known as cases of one-shot learning.Examples include analyzing network traffic under zero-day attacks, and computervision tasks by sensor networks deployed in the field. To handle thischallenging task, organizations often use human analysts to classify eventsunder high uncertainty. Existing algorithms use a threshold-based mechanism todecide whether to classify an object automatically or send it to an analyst fordeeper inspection. However, this approach leads to a significant waste ofresources since it does not take the practical temporal constraints of systemresources into account. Our contribution is threefold. First, we develop anovel Deep Reinforcement One-shot Learning (DeROL) framework to address thischallenge. The basic idea of the DeROL algorithm is to train a deep-Q networkto obtain a policy which is oblivious to the unseen classes in the testingdata. Then, in real-time, DeROL maps the current state of the one-shot learningprocess to operational actions based on the trained deep-Q network, to maximizethe objective function. Second, we develop the first open-source software forpractical artificially intelligent one-shot classification systems with limitedresources for the benefit of researchers in related fields. Third, we presentan extensive experimental study using the OMNIGLOT dataset for computer visiontasks and the UNSW-NB15 dataset for intrusion detection tasks that demonstratesthe versatility and efficiency of the DeROL framework.