Reinforcement Learning-Based Television White Space Database

Main Article Content

Armie E. Pakzad
Raine Mattheus Manuel
Jerrick Spencer Uy
Xavier Francis Asuncion
Joshua Vincent Ligayo
Lawrence Materum

Abstract

Television white spaces (TVWSs) refer to the unused part of the spectrum under the very high frequency (VHF) and ultra-high frequency (UHF) bands. TVWS are frequencies under licenced primary users (PUs) that are not being used and are available for secondary users (SUs). There are several ways of implementing TVWS in communications, one of which is the use of TVWS database (TVWSDB). The primary purpose of TVWSDB is to protect PUs from interference with SUs. There are several geolocation databases available for this purpose. However, it is unclear if those databases have the prediction feature that gives TVWSDB the capability of decreasing the number of inquiries from SUs. With this in mind, the authors present a reinforcement learning-based TVWSDB. Reinforcement learning (RL) is a machine learning technique that focuses on what has been done based on mapping situations to actions to obtain the highest reward. The learning process was conducted by trying out the actions to gain the reward instead of being told what to do. The actions may directly affect the rewards and future rewards. Based on the results, this algorithm effectively searched the most optimal channel for the SUs in query with the minimum search duration. This paper presents the advantage of using a machine learning approach in TVWSDB with an accurate and faster-searching capability for the available TVWS channels intended for SUs.

Downloads

Download data is not yet available.

Article Details

How to Cite
1.
Pakzad AE, Manuel RM, Uy JS, Asuncion XF, Ligayo JV, Materum L. Reinforcement Learning-Based Television White Space Database. Baghdad Sci.J [Internet]. 2021Jun.20 [cited 2021Aug.3];18(2(Suppl.):0947. Available from: https://bsj.uobaghdad.edu.iq/index.php/BSJ/article/view/6215
Section
article

References

Prata A, Oliveira ASR, Carvalho NB. An Agile Digital Radio System for UHF White Spaces. IEEE Microwave Magazine. 2014;15,92–97.

Barrie M, Delaere S, Sukarevičienė G, Gesquiere J, Moerman I. Geolocation database beyond TV white spaces? Matching applications with database requirements. 2012 IEEE International Symposium on Dynamic Spectrum Access Networks. 2012;467–478.

Luo Y, Gao L, Huang J. Business modeling for TV white space networks. IEEE Communications Magazine, 2015;53,82–88.

Trinidad E, Materum L. Juxtaposition of Extant TV White Space Technologies for Long-Range Opportunistic Wireless Communications. International Journal of Emerging Trends in Engineering Research. 2019.

Pakzad AE, Pakzad AA, Materum L. Proposed Joint Propagation and Reinforcement Learning-based Television White Space Ledger. International Journal of Emerging Trends in Engineering Research. 2020;8(4).

Anabi KH, Nordin R, Abdullah NF. Database-assisted television white space technology: Challenges, trends and future research directions. 2016;4,8162–8183.

Mueck M, Noguet D. TV white space standardization and regulation in Europe. 2011 2nd International Conference on Wireless Communication, Vehicular Technology, Information Theory and Aerospace & Electronic Systems Technology (Wireless VITAE). 2011;1–5.

Feng X, Zhang J, Zhang Q. Database-assisted multi-ap network on tv white spaces: Architecture, spectrum allocation and ap discovery. 2011 IEEE International Symposium on Dynamic Spectrum Access Networks (DySPAN), 2011;265–276.

Sun C, Villardi GP, Lan Z, Alemseged YD, Tran HN, Harada H. Coexistence of secondary user networks under primary user constraints in TV white space. 2012 IEEE Wireless Communications and Networking Conference (WCNC). 2012;2146–2150.

Kokkinen H. TV White Space Spectrum Sharing Using Geolocation Databases. In TV White Space Communications and Networks. Elsevier. 2018;29-43.

Ojaniemi J, Poikonen J, Wichman R. Effect of geolocation database update algorithms to the use of TV white spaces. 2012 7th International ICST Conference on Cognitive Radio Oriented Wireless Networks and Communications (CROWNCOM). 2012;18–23.

Xue Z, & Wang L. Geolocation database based resource sharing among multiple device-to-device links in TV white space. 2015 International Conference on Wireless Communications & Signal Processing (WCSP). 2015;1–6.

Puspita RH, Shah SDA, Lee G, Roh B, Oh J, Kang S. Reinforcement Learning Based 5G Enabled Cognitive Radio Networks. 2019 International Conference on Information and Communication Technology Convergence (ICTC). 2019;555–558.

Dionisio R, Ribeiro J, Ribeiro J, Marques P, Rodriguez J. Cross-platform demonstrator combining spectrum sensing and a geo-location database. 2012 Future Network & Mobile Summit (FutureNetw), 2012;1–9.

Martin J, Dooley L, Wong K. A new cross-layer dynamic spectrum access architecture for TV white space cognitive radio applications. 2013.

Alhammadi A, Roslee M, Alias MY. Fuzzy logic based negotiation approach for spectrum handoff in cognitive radio network. 2016 IEEE 3rd International Symposium on Telecommunication Technologies (ISTT). 2016;120–124.

Wang C, Ma M, Zhao Z. Design of a novel dynamic trust model for spectrum management in WRANs of TV white space. Journal of Network and Computer Applications. 2017;100,1–10.

Sutton RS, Barto AG. Reinforcement learning: An introduction. MIT press. 2018.

Mathworks. (n.d.). Reinforcement Learning with MATLAB Understanding the Basics and Setting Up the Environment the Environment.

Government of Canada, DBS-01 — White Space Database Specifications. 2020. available at https://www.ic.gc.ca/eic/site/smt-gst.nsf/eng/sf10928.html.

Zurutuza, N. Cognitive Radio and TV White Space Communications: TV White Space Geolocation Database System [Master’s Thesis]:Institutt for elektronikk og telekommunikasjon. 2011.