Abstract
Autism spectrum disorder (ASD) is a developmental disorder characterized bysignificant social communication impairments and difficulties perceiving andpresenting communication cues. Machine learning techniques have been broadlyadopted to facilitate autism studies and assessments. However, computationalmodels are primarily concentrated on specific analysis and validated on privatedatasets in the autism community, which limits comparisons across models due toprivacy-preserving data sharing complications. This work presents a novelprivacy-preserving open-source dataset, MMASD as a MultiModal ASD benchmarkdataset, collected from play therapy interventions of children with Autism.MMASD includes data from 32 children with ASD, and 1,315 data samples segmentedfrom over 100 hours of intervention recordings. To promote public access, eachdata sample consists of four privacy-preserving modalities of data: (1) opticalflow, (2) 2D skeleton, (3) 3D skeleton, and (4) clinician ASD evaluation scoresof children, e.g., ADOS scores. MMASD aims to assist researchers and therapistsin understanding children's cognitive status, monitoring their progress duringtherapy, and customizing the treatment plan accordingly. It also hasinspiration for downstream tasks such as action quality assessment andinterpersonal synchrony estimation. MMASD dataset can be easily accessed athttps://github.com/Li-Jicheng/MMASD-A-Multimodal-Dataset-for-Autism-Intervention-Analysis.