Yang, Jing and Awais, Muhammad and Hossain, Md. Amzad and Yee, Por Lip and Haowei, Ma. and Mehedi, Ibrahim M. and Iskanderani, A. I. M. (2023) Thoughts of brain EEG signal-to-text conversion using weighted feature fusion-based Multiscale Dilated Adaptive DenseNet with Attention Mechanism. Biomedical Signal Processing and Control, 86 (A). ISSN 1746-8094, DOI https://doi.org/10.1016/j.bspc.2023.105120.
Full text not available from this repository.Abstract
Individuals with visual inefficiencies or different abilities face difficulties using their hands to operate smart -phones and computers, necessitating reliance on others to enter data. Such dependence may lead to security and privacy issues, especially when sensitive information is shared with helpers. To address this problem, we present Think2Type, an efficient Brain-Computer Interface (BCI) that enables users to translate their active intentions into text format based on Morse code. BCI leverages brain activity to facilitate interaction with computers, often captured via Electroencephalography (EEG). This work proposes an enhanced attention-based deep learning strategy to develop an efficient text conversion mechanism from EEG signals. We begin by collecting EEG signals from standard benchmark datasets and extracting spectral and statistical features in phase 1, concatenating them into concatenated feature set 1 (F1). In phase 2, we extract spatial and temporal features via a One-Dimensional Convolutional Neural Network (1DCNN) and a Recurrent Neural Network (RNN), respectively, concatenating them into concatenated feature set 2 (F2). Weighted feature fusion is performed on concatenated features F1 and F2, with the hybrid optimization algorithm Eurasian Oystercatcher Wild Geese Migration Optimization (EOWGMO) optimizing the weight for improved fusion efficiency. The text conversion phase utilizes the Mul-tiscale Dilated Adaptive DenseNet with Attention Mechanism (MDADenseNet-AM) to obtain the converted text information. The MDADenseNet-A's parameters are optimized to improve thought-to-text conversion perfor-mance. The developed model's performance is evaluated via experimental analysis and compared to conven-tional techniques, resulting in a higher accuracy value of 96.41%, facilitating appropriate text conversion.
| Item Type: | Article |
|---|---|
| Funders: | King Abdulaziz University (KEP-MSc:90-135-1443) |
| Uncontrolled Keywords: | Thought-to-text conversion; Electroencephalography signal; Optimal weighted feature fusion; Eurasian oystercatcher wild geese migration optimization; Multiscale Dilated Adaptive DenseNet with Attention Mechanism |
| Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science T Technology > TJ Mechanical engineering and machinery T Technology > TK Electrical engineering. Electronics Nuclear engineering |
| Divisions: | Faculty of Computer Science & Information Technology > Department of Computer System & Technology Faculty of Engineering > Department of Mechanical Engineering |
| Depositing User: | Ms. Juhaida Abd Rahim |
| Date Deposited: | 30 Jul 2025 03:02 |
| Last Modified: | 30 Jul 2025 03:02 |
| URI: | http://eprints.um.edu.my/id/eprint/50743 |
Actions (login required)
 |
View Item |
