Deep Learning Models and Fusion Classification Technique for Accurate Diagnosis of Retinopathy of Prematurity in Preterm Newborn

Nazar Salih; Mohamed Ksantini; Nebras Hussein; Donia Ben Halima; ali Abdul Razzaq; Sohaib Ahmed

doi:10.21123/bsj.2023.8747

Authors

Nazar Salih National School of Electronic and Telecommunications, University of Sfax, Tunisia. https://orcid.org/0000-0003-1977-9387
Mohamed Ksantini Control and Energies Management Laboratory (CEM-Lab), National Engineering School of Sfax, University of Sfax, Sfax, Tunisia. https://orcid.org/0000-0002-9928-8643
Nebras Hussein Biomedical Engineering Department, Al-Khwarizmi College of Engineering University of Baghdad, Iraq. https://orcid.org/0000-0002-9812-0718
Donia Ben Halima Control and Energies Management Laboratory (CEM-Lab), National Engineering School of Sfax, University of Sfax, Sfax, Tunisia. https://orcid.org/0000-0002-3893-6213
ali Abdul Razzaq Ibn AL Haitham Teaching Eye Hospital, Baghdad, Iraq. https://orcid.org/0009-0007-7471-8604
Sohaib Ahmed

DOI:

https://doi.org/10.21123/bsj.2023.8747

Keywords:

Artificial intelligence, Deep learning, Fusion classifier, Fundus images, Retinopathy of prematurity.

Abstract

Retinopathy of prematurity (ROP) is the most common cause of irreversible childhood blindness, and its diagnosis and treatment rely on subjective grading based on retinal vascular features. However, this method is laborious and error-prone, so automated approaches are desirable for greater precision and productivity. This study aims to develop a deep learning-based strategy to accurately diagnose the plus disease of ROP in preterm newborns using transfer learning models and a fusion classification technique. The Private Clinic Al-Amal Eye Center in Baghdad, Iraq, provided us with 2776 ROP screening fundus images between 2015 and 2020, and the images were used to train three deep convolutional neural network models (ResNet50, Densenet161, and EfficientNetB5). A fusion classifier approach was used to merge the three models for a thorough and precise diagnosis. The three models have relative accuracy rates of 69.78%, 80.57 %, and 81.29 % in their respective classifications. The overall accuracy, however, increased to 90.28 percent when the fusion classifier was employed. This shows that the proposed method helps identify ROP in premature infants. The study's findings imply the proposed method has the potential to significantly enhance the precision and speed with which ROP is diagnosed, which in turn could lead to earlier detection and treatment of the illness and a decreased likelihood of childhood blindness.

Received 14/03/2023

Revised 14/07/2023

Accepted 16/07/2023

Published Online First 20/10/2023

Author Biographies

Mohamed Ksantini, Control and Energies Management Laboratory (CEM-Lab), National Engineering School of Sfax, University of Sfax, Sfax, Tunisia.

Nebras Hussein, Biomedical Engineering Department, Al-Khwarizmi College of Engineering University of Baghdad, Iraq.

Donia Ben Halima , Control and Energies Management Laboratory (CEM-Lab), National Engineering School of Sfax, University of Sfax, Sfax, Tunisia.

ali Abdul Razzaq , Ibn AL Haitham Teaching Eye Hospital, Baghdad, Iraq.

Sohaib Ahmed

References

Hong EH, Shin YU, Cho H. Retinopathy of prematurity: a review of epidemiology and current treatment strategies. Clin Exp Pediatr. 2022 Mar; 65(3): 115-126. https://doi.org/10.3345/cep.2021.00773.

Palmer EA, Flynn JT, Hardy RJ, Phelps DL, Phillips CL, Schaffer DB, et al. Incidence and early course of retinopathy of prematurity. Ophthalmology. 2020; 127(4 Suppl): S84-S96. https://doi.org/10.1016/j.ophtha.2020.01.034.

Committee for the Classification of Retinopathy of Prematurity. An international classification of retinopathy of prematurity. Pediatrics. 1984; 74(1): 127-133. https://doi.org/10.1016/s0031-3955(16)39015-3.

International Committee for the Classification of Retinopathy of Prematurity. The International Classification of Retinopathy of Prematurity revisited. Arch Ophthalmol. 2005; 123(7): 991-999. https://doi.org/10.1001/archopht.123.7.991.

Chiang MF, Quinn GE, Fielder AR, Ostmo SR, Paul RV, Berrocal A, et al. International Classification of Retinopathy of Prematurity, Third Edition. Ophthalmology. 2021 Oct; 128(10): e51-e68. https://doi.org/10.1016/j.ophtha.2021.05.031.

Chiang MF, Jiang L, Gelman R, Du YE, Flynn JT. Interexpert agreement of plus disease diagnosis in retinopathy of prematurity. Arch Ophthalmol. 2007; 125(7): 875–80. https://doi.org/10.1001/archopht.125.7.875.

Brady CJ, D'Amico S, Campbell JP. Telemedicine for Retinopathy of Prematurity. Telemed J E Health. 2020 Apr; 26(4): 556-564. https://doi.org/10.1089/tmj.2020.0010.

M. Ksantini, A. Ben Hassena and F. Delmotte, Comparison and fusion of classifiers applied to a medical diagnosis. 2017 14th Int Multi-Conf Syst Signals Devices (SSD), Marrakech, Morocco; 2017. p. 211-216. https://doi.org/10.1109/SSD.2017.8166985

Mosa Z M, Ghaeb N H, Ali A H. Detecting Keratoconus by Using SVM and Decision Tree Classifiers with the Aid of Image Processing. Baghdad Sic. J. 2019; 16(4(Suppl.), 1022. https://doi.org/10.21123/bsj.2019.16.4(Suppl.).1022

Chakraborty S, Jana GC, Kumari D, Swetapadma A. An improved method using supervised learning technique for diabetic retinopathy detection. Int J Inf Technol. 2019. 12: 473-477. https://doi.org/10.1007/s41870-019-00318-6

Hasan A M, Qasim A F, Jalab H A, Ibrahim R W. Breast Cancer MRI Classification Based on Fractional Entropy Image Enhancement and Deep Feature Extraction. Baghdad Baghdad Sic J.2023; 20(1), 0221. https://doi.org/10.21123/bsj.2022.6782

Sarker IH. Deep Learning: A Comprehensive Overview on Techniques, Taxonomy, Applications and Research Directions. SN Comput. Sci. 2021; 2(3): 420. https://doi.org/10.1007/s42979-021-00815-1.

Salih N, Hussein N. Human corneal state prediction from topographical maps using a deep neural network and a support vector machine. Int. J. Curr. Res. 2018; 10(11): 75461-75467. https://doi.org/10.13140/RG.2.2.30320.94726

Salih N, Ksantini M, Hussein N, Halima DB, Razzaq AA, Mahmood SA. Detection of Retinopathy of Prematurity Stages Utilizing Deep Neural Networks. 7th Int Cong Info Commun Technolo. 2023: 771-782. Springer. https://doi.org/10.1007/978-981-19-1607-6_62

Sarvamangala DR, Kulkarni RV. Convolutional neural networks in medical image understanding: a survey. Evol Intell. 2022; 15(1): 1-22. https://doi.org/10.1007/s12065-020-00540-3.

Barriada RG, Masip D. An Overview of Deep-Learning-Based Methods for Cardiovascular Risk Assessment with Retinal Images. Diagnostics. 2023; 13(1): 68. https://doi.org/10.3390/diagnostics13010068.

Ait Nasser A, Akhloufi MA. A Review of Recent Advances in Deep Learning Models for Chest Disease Detection Using Radiography. Diagnostics. 2023; 13(1): 159. https://doi.org/10.3390/diagnostics13010159.

Hosna A, Merry E, Gyalmo J, Alom Z, Aung Z, Azim MA. Transfer learning: a friendly introduction. J Big Data. 2022; 9: 102. https://doi.org/10.1186/s40537-022-00652-w.

Rothe S, Kudszus B, Söffker D. Does Classifier Fusion Improve the Overall Performance? Numerical Analysis of Data and Fusion Method Characteristics Influencing Classifier Fusion Performance. Entropy (Basel). 2019 Sep 5; 21(9): 866. https://doi.org/10.3390/e21090866.

Brown JM, Campbell JP, Beers A, Chang K, Ostmo S, Chan RVP, et al. Automated diagnosis of plus disease in retinopathy of prematurity using deep convolutional neural networks. JAMA Ophthalmol. 2018; 136(7): 803-810.https://doi.org/10.1001/jamaophthalmol.2018.1934.

Redd TK, Campbell JP, Brown JM, Kim SJ, Ostmo S, Chan RVP, et al. Evaluation of a deep learning image assessment system for detecting severe retinopathy of prematurity. Br J Ophthalmol. 2019; 103(5): 580-584. https://doi.org/10.1136/bjophthalmol-2018-313156.

Tan Z, Simkin S, Lai C, Dai S. Deep learning algorithm for automated diagnosis of retinopathy of prematurity plus disease. Transl Vis Sci Technol. 2019; 8(6): 23. https://doi.org/10.1167/tvst.8.6.23.

Mao J, Zhang Y, Zhang Y, Guo Q, Zhang L, Dai R, et al. Automated diagnosis and quantitative analysis of plus disease in retinopathy of prematurity based on deep convolutional neural networks. Acta Ophthalmol. 2020; 98(3): e352-e359. https://doi.org/10.1111/aos.14264.

Hu J, Chen Y, Zhong J, Ju R, Yi Z. Automated analysis for retinopathy of prematurity by deep neural networks. IEEE Trans Med Imaging. 2018; 38(1): 269–79. https://doi.org/10.1109/TMI.2018.2865357.

Wang J, Ju R, Chen Y, Zhang L, Hu J, Wu Y, et al. Automated retinopathy of prematurity screening using deep neural networks. EBio Medicine. 2018; 35: 361–8. https://doi.org/10.1016/j.ebiom.2018.07.028.

Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. J Am Med Assoc. 2016; 316(22): 2402–10. https://doi.org/10.1001/jama.2016.17216.

Brown JM, Campbell JP, Beers A, Chang K, Ostmo S, Chan RP, et al. Automated diagnosis of plus disease in retinopathy of prematurity using deep convolutional neural networks. J Am Med Assoc. 2018; 136(7): 803–10. https://doi.org/10.1001/jamaophthalmol.2018.1934.

Wang J, Ju R, Chen Y, Zhang L, Hu J, Wu Y, et al. Automated retinopathy of prematurity screening using deep neural networks. EBio Medicine. 2018; 35: 361-368. https://doi.org/10.1016/j.ebiom.2018.08.033

Huang Y-P, Li Y-C, Liu C-C, Wu J-Y, Huang S-H, Chen Y-J, et al. Deep learning models for automated diagnosis of retinopathy of prematurity in preterm infants. Electronics. 2020; 9(9): 1444. https://www.mdpi.com/2079-9292/9/9/1444.

Zaidi SAJ, Tariq S, Belhaouari SB. Future prediction of COVID-19 vaccine trends using a voting classifier. Data. 2021; 6(11): 112. https://doi.org/10.3390/data6110112.

Pour EK, Pourreza H, Zamani KA, Mahmoud A, Sadeghi AM, Shadravan M, et al. Retinopathy of prematurity-assist: Novel software for detecting plus disease. Korean J Ophthalmol. 2017; 31(6): 524-532. https://doi.org/10.3341/kjo.2017.0012.

Coyner AS, Campbell JP, Ostmo S, Kim SJ, Jonas KE, Paul RV, et al. Machine Learning for Prediction of Retinopathy of Prematurity Fundus Image Quality from Clinical Data. Investig Ophthalmol Vis Sci. 2019; 60(9): 1525-1525. https://doi.org/10.1167/iovs.19-27311.

Agrawal R, Kulkarni S, Walambe R, Kotecha K. Assistive framework for automatic detection of all the zones in retinopathy of prematurity using deep learning. J Digit Imaging. 2021; 34(4): 932-947. https://doi.org/10.1007/s10278-021-00455-2.