Student Engagement Detection Using Emotion Analysis, Eye Tracking and Head Movement with Machine Learning

  • 2020-09-28 16:56:12
  • Prabin Sharma, Shubham Joshi, Subash Gautam, Sneha Maharjan, Vitor Filipe, Manuel J. C. S. Reis
  • 0

Abstract

With the increase of distance learning, in general, and e-learning, inparticular, having a system capable of determining the engagement of studentsis of primordial importance, and one of the biggest challenges, both forteachers, researchers and policy makers. Here, we present a system to detectthe engagement level of the students. It uses only information provided by thetypical built-in web-camera present in a laptop computer, and was designed towork in real time. We combine information about the movements of the eyes andhead, and facial emotions to produce a concentration index with three classesof engagement: "very engaged", "nominally engaged" and "not engaged at all".The system was tested in a typical e-learning scenario, and the results showthat it correctly identifies each period of time where students were "veryengaged", "nominally engaged" and "not engaged at all". Additionally, theresults also show that the students with best scores also have higherconcentration indexes.

 

Quick Read (beta)

loading the full paper ...