Facial Affect Recognition based on Multi Architecture Encoder and Feature Fusion for the ABAW7 Challenge

  • 2024-07-26 09:42:10
  • Kang Shen, Xuxiong Liu, Boyan Wang, Jun Yao, Xin Liu, Yujie Guan, Yu Wang, Gengchen Li, Xiao Sun
  • 0

Abstract

In this paper, we present our approach to addressing the challenges of the7th ABAW competition. The competition comprises three sub-challenges: ValenceArousal (VA) estimation, Expression (Expr) classification, and Action Unit (AU)detection. To tackle these challenges, we employ state-of-the-art models toextract powerful visual features. Subsequently, a Transformer Encoder isutilized to integrate these features for the VA, Expr, and AU sub-challenges.To mitigate the impact of varying feature dimensions, we introduce an affinemodule to align the features to a common dimension. Overall, our resultssignificantly outperform the baselines.

 

Quick Read (beta)

loading the full paper ...