IMUVIE: Pickup Timeline Action Localization via Motion Movies

  • 2024-11-19 17:53:30
  • John Clapham, Kenneth Koltermann, Yanfu Zhang, Yuming Sun, Evie N Burnet, Gang Zhou
  • 0

Abstract

Falls among seniors due to difficulties with tasks such as picking up objectspose significant health and safety risks, impacting quality of life andindependence. Reliable, accessible assessment tools are critical for earlyintervention but often require costly clinic-based equipment and trainedpersonnel, limiting their use in daily life. Existing wearable-based pickupmeasurement solutions address some needs but face limitations ingeneralizability. We present IMUVIE, a wearable system that uses motion movies and amachine-learning model to automatically detect and measure pickup events,providing a practical solution for frequent monitoring. IMUVIE's designprinciples-data normalization, occlusion handling, and streamlinedvisuals-enhance model performance and are adaptable to tasks beyond pickupclassification. In rigorous leave one subject out cross validation evaluations, IMUVIEachieves exceptional window level localization accuracy of 91-92% for pickupaction classification on 256,291 motion movie frame candidates whilemaintaining an event level recall of 97% when evaluated on 129 pickup events.IMUVIE has strong generalization and performs well on unseen subjects. In aninterview survey, IMUVIE demonstrated strong user interest and trust, with easeof use identified as the most critical factor for adoption. IMUVIE offers apractical, at-home solution for fall risk assessment, facilitating earlydetection of movement deterioration, and supporting safer, independent livingfor seniors.

 

Quick Read (beta)

loading the full paper ...