Kabir, Homayun and Tham, Mau-Luen and Chang, Yoong Choon and Chow, Chee-Onn and Owada, Yasunori (2023) Mobility-aware resource allocation in IoRT network for post-disaster communications with parameterized reinforcement learning. Sensors, 23 (14). ISSN 1424-8220, DOI https://doi.org/10.3390/s23146448.
Full text not available from this repository.Abstract
Natural disasters, including earthquakes, floods, landslides, tsunamis, wildfires, and hurricanes, have become more common in recent years due to rapid climate change. For Post-Disaster Management (PDM), authorities deploy various types of user equipment (UE) for the search and rescue operation, for example, search and rescue robots, drones, medical robots, smartphones, etc., via the Internet of Robotic Things (IoRT) supported by cellular 4G/LTE/5G and beyond or other wireless technologies. For uninterrupted communication services, movable and deployable resource units (MDRUs) have been utilized where the base stations are damaged due to the disaster. In addition, power optimization of the networks by satisfying the quality of service (QoS) of each UE is a crucial challenge because of the electricity crisis after the disaster. In order to optimize the energy efficiency, UE throughput, and serving cell (SC) throughput by considering the stationary as well as movable UE without knowing the environmental priori knowledge in MDRUs aided two-tier heterogeneous networks (HetsNets) of IoRT, the optimization problem has been formulated based on emitting power allocation and user association combinedly in this article. This optimization problem is nonconvex and NP-hard where parameterized (discrete: user association and continuous: power allocation) action space is deployed. The new model-free hybrid action space-based algorithm called multi-pass deep Q network (MP-DQN) is developed to optimize this complex problem. Simulations results demonstrate that the proposed MP-DQN outperforms the parameterized deep Q network (P-DQN) approach, which is well known for solving parameterized action space, DQN, as well as traditional algorithms in terms of reward, average energy efficiency, UE throughput, and SC throughput for motionless as well as moveable UE.
| Item Type: | Article |
|---|---|
| Funders: | Universiti Tunku Abdul Rahman (UTAR), Malaysia [Grant No: IPSR/RMC/UTARRF/2021C1/T05] |
| Uncontrolled Keywords: | Post disaster communication; Internet of robotic things (IoRT); Movable and deployable resource units (MDRU); Deep reinforcement learning (DRL); Parameterized action space; Multi-pass deep Q network (MP-DQN) |
| Subjects: | Q Science > QD Chemistry T Technology > TK Electrical engineering. Electronics Nuclear engineering |
| Divisions: | Faculty of Engineering > Department of Electrical Engineering |
| Depositing User: | Ms. Juhaida Abd Rahim |
| Date Deposited: | 08 Nov 2025 11:03 |
| Last Modified: | 08 Nov 2025 11:03 |
| URI: | http://eprints.um.edu.my/id/eprint/49739 |
Actions (login required)
 |
View Item |
