Abstract
Healthcare data suffers from both noise and lack of ground truth. The cost ofdata increases as it is cleaned and annotated in healthcare. Unlike other datasets, medical data annotation, which is critical to accurate ground truth,requires medical domain expertise for a better patient outcome. In this work,we report on the use of reinforcement learning to mimic the decision makingprocess of annotators for medical events, to automate annotation and labelling.The reinforcement agent learns to annotate alarm data based on annotations doneby an expert. Our method shows promising results on medical alarm data sets. Wetrained DQN and A2C agents using the data from monitoring devices annotated byan expert. Initial results from these RL agents learning the expert annotationbehavior are promising. The A2C agent performs better in terms of learning thesparse events in a given state, thereby choosing more right actions compared toDQN agent. To the best of our knowledge, this is the first reinforcementlearning application for the automation of medical events annotation, which hasfar-reaching practical use.