Liew, Wei Shiung and Loo, Chu Kiong and Wermter, Stefan (2021) Emotion recognition using explainable genetically optimized fuzzy ART ensembles. IEEE Access, 9. pp. 61513-61531. ISSN 2169-3536, DOI https://doi.org/10.1109/ACCESS.2021.3072120.
Full text not available from this repository.Abstract
There is a growing demand for explainability in complex artificial intelligence solutions to support critical applications' decision-making processes. Barriers to explainable processes include black-box classifiers, such as deep learning, and noisy datasets. Affect recognition involving neural networks attempts to map complex human emotions onto Arousal and Valence scales based on physiological signal measurements. Datasets collected for this purpose are inherently noisy and may contain outliers and imbalanced classes, hindering accurate classification. In our approach, these issues are addressed using Fuzzy ART (FA) for clustering data samples into more condensed memory templates, introducing stochastic resonant noise to amplify signal-to-noise ratio, and SMOTE sampling to generate synthetic minority samples. A genetic algorithm is developed for FA optimization and ensemble model selection. Clusters obtained from the resulting ensembles are then used to train an ensemble of boosted decision trees for classification and to visualize the decision-making processes. Individual features such as heart rate variability and EEG band power, as well as feature interactions between pairs of features, may contain critical information as human affect indicators. Contributions of individual features and feature interactions toward describing human affect are quantified and interpreted using Shapley additive explanation values. Three established affect recognition datasets were considered for mapping physiological features onto a binary classification of Low/High Arousal and Positive/Negative Valence. Our framework was able to achieve good generalization for both classification tasks as well as provide detailed insights into the contributions of physiological features towards describing Arousal and Valence affects.
| Item Type: | Article |
|---|---|
| Funders: | Georg Forster Research Fellowship for Experienced Researchers from the Alexander von Humboldt-Stiftung/Foundation, German Research Foundation (DFG) (TRR169), Impact Oriented Interdisciplinary Research Grant (IIRG) from the University of Malaya (IIRG002C-19HWB) |
| Uncontrolled Keywords: | Physiology; Feature extraction; Emotion recognition; Training; Brain modeling; Noise measurement; Genetic algorithms; Affective computing; Decision support systems; Genetic algorithms; Hybrid intelligent systems; Knowledge-based systems; Pattern clustering; Regression analysis |
| Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science T Technology > TA Engineering (General). Civil engineering (General) T Technology > TK Electrical engineering. Electronics Nuclear engineering |
| Divisions: | Faculty of Computer Science & Information Technology > Department of Artificial Intelligence |
| Depositing User: | Ms Zaharah Ramly |
| Date Deposited: | 08 Apr 2022 05:42 |
| Last Modified: | 08 Apr 2022 05:42 |
| URI: | http://eprints.um.edu.my/id/eprint/27010 |
Actions (login required)
 |
View Item |
