Speech emotion recognition by late fusion for bidirectional reservoir computing with random projection

Ibrahim, Hemin and Loo, Chu Kiong and Alnajjar, Fady (2021) Speech emotion recognition by late fusion for bidirectional reservoir computing with random projection. IEEE Access, 9. pp. 122855-122871. ISSN 2169-3536, DOI https://doi.org/10.1109/ACCESS.2021.3107858.

Full text not available from this repository.

Abstract

Many researchers are inspired by studying Speech Emotion Recognition (SER) because it is considered as a key effort in Human-Computer Interaction (HCI). The main focus of this work is to design a model for emotion recognition from speech, which has plenty of challenges within it. Due to the time series and sparse nature of emotion in speech, we have adopted a multivariate time series feature representation of the input data. The work has also adopted the Echo State Network (ESN) which includes reservoir computing as a special case of the Recurrent Neural Network (RNN) to avoid model complexity because of its untrained and sparse nature when mapping the features into a higher dimensional space. Additionally, we applied dimensionality reduction since it offers significant computational advantages by using Sparse Random Projection (SRP). Late fusion of bidirectionality input has been applied to capture additional information independently of the input data. The experiments for speaker-independent and/or speaker-dependent were performed on four common speech emotion datasets which are Emo-DB, SAVEE, RAVDESS, and FAU Aibo Emotion Corpus. The results show that the designed model outperforms the state-of-the-art with a cheaper computation cost.

Item Type: Article
Funders: UNSPECIFIED
Uncontrolled Keywords: Feature extraction; Reservoirs; Time series analysis; Speech recognition; Emotion recognition; Human computer interaction; Principal component analysis; Speech emotion recognition; reservoir computing; time series classification; random projection; recurrent neural network
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
T Technology > TA Engineering (General). Civil engineering (General)
Divisions: Faculty of Computer Science & Information Technology > Department of Artificial Intelligence
Depositing User: Ms Zaharah Ramly
Date Deposited: 10 Jun 2022 07:18
Last Modified: 10 Jun 2022 07:18
URI: http://eprints.um.edu.my/id/eprint/27598

Actions (login required)

View Item View Item