Reinforcement learning-enabled Intelligent Device-to-Device (I-D2D) communication in Narrowband Internet of Things (NB-IoT)

dc.authoridCengiz, Korhan/0000-0001-6594-8861
dc.authoridJamshed, Muhammad Ali/0000-0002-2141-9025
dc.authoridNauman, Ali/0000-0002-2133-5286
dc.authoridCengiz, Korhan/0000-0001-6594-8861
dc.authoridAli, Rashid/0000-0002-9756-1909
dc.authorwosidCengiz, Korhan/HTN-8060-2023
dc.authorwosidJamshed, Muhammad Ali/AAB-3421-2019
dc.authorwosidNauman, Ali/KJD-5577-2024
dc.authorwosidCengiz, Korhan/ABD-5559-2020
dc.contributor.authorNauman, Ali
dc.contributor.authorJamshed, Muhammad Ali
dc.contributor.authorAli, Rashid
dc.contributor.authorCengiz, Korhan
dc.contributor.authorZulqarnain
dc.contributor.authorKim, Sung Won
dc.date.accessioned2024-06-12T11:13:28Z
dc.date.available2024-06-12T11:13:28Z
dc.date.issued2021
dc.departmentTrakya Üniversitesien_US
dc.description.abstractThe 5th Generation (5G) and Beyond 5G (B5G) are expected to be the enabling technologies for Internet-of-Everything (IoE). The quality-of-service (QoS) for IoE in the context of uplink data delivery of the content is of prime importance. The 3rd Generation Partnership Project (3GPP) standardizes the Narrowband Internet-of-Things (NB-IoT) in 5G, which is Low Power Wide Area (LPWA) technology to enhance the coverage and to optimize the power consumption for the IoT devices. Repetitions of control and data signals between NB-IoT User Equipment (UE) and the evolved NodeB/Base Station (eNB/BS), is one of the most prominent characteristics in NB-IoT. These repetitions ensure high reliability in the context of data delivery of time-sensitive applications, e.g., healthcare applications. However, these repetitions degrade the performance of the resource-constrained IoT network in terms of energy consumption. Device-to-Device (D2D) communication standardized in Long Term Evolution-Advanced (LTE-A) offers a key solution for NB-IoT UE to transmit in two hops route instead of direct uplink, which augments the efficiency of the system. In an effort to improve the data packet delivery, this study investigates D2D communication for NB-IoT delay-sensitive applications, such as healthcare-IoT services. This study formulates the selection of D2D communication relay as Multi-Armed Bandit (MAB) problem and incorporates Upper Confidence Bound (UCB) based Reinforcement Learning (RL) to solve MAB problem. The proposed Intelligent-D2D (I-D2D) communication methodology selects the optimum relay with a maximum Packet Delivery Ratio (PDR) with minimum End-to-End Delay (EED), which ultimately augments energy efficiency.en_US
dc.description.sponsorshipMSIT (Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program [IITP-2020-2016-0-00313]; National Research Foundation of Korea (NRF) - Ministry of Education [2018R1D1A1A09082266]en_US
dc.description.sponsorshipThis research was supported in part by the MSIT (Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2020-2016-0-00313) supervised by the IITP (Institute for Information & communications Technology Planning & Evaluation) and in part by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2018R1D1A1A09082266).en_US
dc.identifier.doi10.1016/j.comcom.2021.05.007
dc.identifier.endpage22en_US
dc.identifier.issn0140-3664
dc.identifier.issn1873-703X
dc.identifier.scopus2-s2.0-85107154955en_US
dc.identifier.scopusqualityQ1en_US
dc.identifier.startpage13en_US
dc.identifier.urihttps://doi.org/10.1016/j.comcom.2021.05.007
dc.identifier.urihttps://hdl.handle.net/20.500.14551/23569
dc.identifier.volume176en_US
dc.identifier.wosWOS:000680413700002en_US
dc.identifier.wosqualityQ1en_US
dc.indekslendigikaynakWeb of Scienceen_US
dc.indekslendigikaynakScopusen_US
dc.language.isoenen_US
dc.publisherElsevieren_US
dc.relation.ispartofComputer Communicationsen_US
dc.relation.publicationcategoryMakale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanıen_US
dc.rightsinfo:eu-repo/semantics/closedAccessen_US
dc.subjectReinforcement Learning (RL)en_US
dc.subjectIntelligent Communicationen_US
dc.subjectDevice-To-Device (D2D) Communicationen_US
dc.subjectNarrowband Internet Of Things (NB-Iot)en_US
dc.subject5th Generation (5G) Networksen_US
dc.titleReinforcement learning-enabled Intelligent Device-to-Device (I-D2D) communication in Narrowband Internet of Things (NB-IoT)en_US
dc.typeArticleen_US

Dosyalar