Reinforcement learning-enabled Intelligent Device-to-Device (I-D2D) communication in Narrowband Internet of Things (NB-IoT)
dc.authorid | Cengiz, Korhan/0000-0001-6594-8861 | |
dc.authorid | Jamshed, Muhammad Ali/0000-0002-2141-9025 | |
dc.authorid | Nauman, Ali/0000-0002-2133-5286 | |
dc.authorid | Cengiz, Korhan/0000-0001-6594-8861 | |
dc.authorid | Ali, Rashid/0000-0002-9756-1909 | |
dc.authorwosid | Cengiz, Korhan/HTN-8060-2023 | |
dc.authorwosid | Jamshed, Muhammad Ali/AAB-3421-2019 | |
dc.authorwosid | Nauman, Ali/KJD-5577-2024 | |
dc.authorwosid | Cengiz, Korhan/ABD-5559-2020 | |
dc.contributor.author | Nauman, Ali | |
dc.contributor.author | Jamshed, Muhammad Ali | |
dc.contributor.author | Ali, Rashid | |
dc.contributor.author | Cengiz, Korhan | |
dc.contributor.author | Zulqarnain | |
dc.contributor.author | Kim, Sung Won | |
dc.date.accessioned | 2024-06-12T11:13:28Z | |
dc.date.available | 2024-06-12T11:13:28Z | |
dc.date.issued | 2021 | |
dc.department | Trakya Üniversitesi | en_US |
dc.description.abstract | The 5th Generation (5G) and Beyond 5G (B5G) are expected to be the enabling technologies for Internet-of-Everything (IoE). The quality-of-service (QoS) for IoE in the context of uplink data delivery of the content is of prime importance. The 3rd Generation Partnership Project (3GPP) standardizes the Narrowband Internet-of-Things (NB-IoT) in 5G, which is Low Power Wide Area (LPWA) technology to enhance the coverage and to optimize the power consumption for the IoT devices. Repetitions of control and data signals between NB-IoT User Equipment (UE) and the evolved NodeB/Base Station (eNB/BS), is one of the most prominent characteristics in NB-IoT. These repetitions ensure high reliability in the context of data delivery of time-sensitive applications, e.g., healthcare applications. However, these repetitions degrade the performance of the resource-constrained IoT network in terms of energy consumption. Device-to-Device (D2D) communication standardized in Long Term Evolution-Advanced (LTE-A) offers a key solution for NB-IoT UE to transmit in two hops route instead of direct uplink, which augments the efficiency of the system. In an effort to improve the data packet delivery, this study investigates D2D communication for NB-IoT delay-sensitive applications, such as healthcare-IoT services. This study formulates the selection of D2D communication relay as Multi-Armed Bandit (MAB) problem and incorporates Upper Confidence Bound (UCB) based Reinforcement Learning (RL) to solve MAB problem. The proposed Intelligent-D2D (I-D2D) communication methodology selects the optimum relay with a maximum Packet Delivery Ratio (PDR) with minimum End-to-End Delay (EED), which ultimately augments energy efficiency. | en_US |
dc.description.sponsorship | MSIT (Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program [IITP-2020-2016-0-00313]; National Research Foundation of Korea (NRF) - Ministry of Education [2018R1D1A1A09082266] | en_US |
dc.description.sponsorship | This research was supported in part by the MSIT (Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2020-2016-0-00313) supervised by the IITP (Institute for Information & communications Technology Planning & Evaluation) and in part by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2018R1D1A1A09082266). | en_US |
dc.identifier.doi | 10.1016/j.comcom.2021.05.007 | |
dc.identifier.endpage | 22 | en_US |
dc.identifier.issn | 0140-3664 | |
dc.identifier.issn | 1873-703X | |
dc.identifier.scopus | 2-s2.0-85107154955 | en_US |
dc.identifier.scopusquality | Q1 | en_US |
dc.identifier.startpage | 13 | en_US |
dc.identifier.uri | https://doi.org/10.1016/j.comcom.2021.05.007 | |
dc.identifier.uri | https://hdl.handle.net/20.500.14551/23569 | |
dc.identifier.volume | 176 | en_US |
dc.identifier.wos | WOS:000680413700002 | en_US |
dc.identifier.wosquality | Q1 | en_US |
dc.indekslendigikaynak | Web of Science | en_US |
dc.indekslendigikaynak | Scopus | en_US |
dc.language.iso | en | en_US |
dc.publisher | Elsevier | en_US |
dc.relation.ispartof | Computer Communications | en_US |
dc.relation.publicationcategory | Makale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanı | en_US |
dc.rights | info:eu-repo/semantics/closedAccess | en_US |
dc.subject | Reinforcement Learning (RL) | en_US |
dc.subject | Intelligent Communication | en_US |
dc.subject | Device-To-Device (D2D) Communication | en_US |
dc.subject | Narrowband Internet Of Things (NB-Iot) | en_US |
dc.subject | 5th Generation (5G) Networks | en_US |
dc.title | Reinforcement learning-enabled Intelligent Device-to-Device (I-D2D) communication in Narrowband Internet of Things (NB-IoT) | en_US |
dc.type | Article | en_US |