Liong, Gen-Bing and Liong, Sze-Teng and Chan, Chee Seng and See, John (2024) SFAMNet: A scene flow attention-based micro-expression network. Neurocomputing, 566. ISSN 0925-2312, DOI https://doi.org/10.1016/j.neucom.2023.126998.
Full text not available from this repository.Abstract
Tremendous progress has been made in facial Micro-Expression (ME) spotting and recognition; however, most works have focused on either spotting or recognition tasks on the 2D videos. Until recently, the estimation of the 3D motion field (a.k.a scene flow) for the ME has only become possible after the release of the multi-modal ME dataset. In this paper, we propose the first Scene Flow Attention-based Micro-expression Network, namely SFAMNet. It takes the scene flow computed using the RGB-D flow algorithm as the input and predicts the spotting confidence score and emotion labels. Specifically, SFAMNet is an attention-based end-to-end multi-stream multi-task network devised to spot and recognize the ME. Besides that, we present a data augmentation strategy to alleviate the small sample size problem during network learning. Extensive experiments are performed on three tasks: (i) ME spotting; (ii) ME recognition; and (iii) ME analysis on the multi-modal CAS(ME)3 dataset. Empirical results indicate that depth is vital in capturing the ME information and the effectiveness of the proposed approach. Our source code is publicly available at https://github.com/genbing99/SFAMNet. © 2023 Elsevier B.V.
| Item Type: | Article |
|---|---|
| Funders: | Ministry of Higher Education, Malaysia [Grant no. FRGS/1/2022/ICT02/HWUM/02/1, JWS 2022/01], Ministry of Science and Technology, Taiwan [Grant no. 111-2221-E-035-059-MY3] |
| Uncontrolled Keywords: | Analysis; Attention; Facial micro-expression; Recognition; Scene flow; Spotting |
| Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
| Divisions: | Faculty of Computer Science & Information Technology > Department of Artificial Intelligence |
| Depositing User: | Ms. Juhaida Abd Rahim |
| Date Deposited: | 20 May 2024 03:58 |
| Last Modified: | 20 May 2024 03:58 |
| URI: | http://eprints.um.edu.my/id/eprint/44916 |
Actions (login required)
 |
View Item |
