摘要
Early diagnosis of Autism Spectrum Disorder (ASD) plays a crucial role in the intervention of ASD. Traditionally, an ASD child needs to be diagnosed by a psychiatrist in the hospital, which is expensive, time-consuming, and influenced by expertise. In this paper, we present an objective, convenient, and effective method for classifying ASD children from raw video sequences by integrating the appearance-based features from facial expressions, head pose, and head trajectory. To better extract facial expression features, we propose a novel attention-based facial expression recognition algorithm to focus on key face areas like eyebrows, mouth, etc. Moreover, we use accumulative histogram to individually extract temporal and spatial information from facial expression, head pose and head trajectory of the video sequence. After fusing these three kinds of features, we feed them to Long Short-Term Memory (LSTM) and achieve a classification accuracy of 96.7% on our self-collected ASD video dataset.
学科与关键词
- Application of Machine Learning Techniques to Detect the Children with Autism Spectrum DisorderLiao, Mengyi*; Duan, Hengyao*; Wang, GuangshuaiJournal of Healthcare Engineering, 2022, 2022: 9340027.被引 15
- Identifying Visual Attention Features Accurately Discerning Between Autism and Typically Developing: a Deep Learning FrameworkXie, Jin; Wang, Longfei; Webster, Paula; Yao, Yang; Sun, Jiayao; Wang, Shuo*; Zhou, Huihui*Interdisciplinary Sciences-Computational Life Sciences, 2022, 14(3): 639-651.被引 6
- A deep learning algorithm-based visual strategy intervention study for children with autism spectrum disorders-extraction and detection of children's behavioral featuresLin, Y.*European Review for Medical and Pharmacological Sciences, 2023, 27(11): 4914-4928.被引 1
