Deep Learning Techniques in the Cancer-Related Medical Domain: A Transfer Deep Learning Ensemble Model for Lung Cancer Prediction
Main Article Content
Abstract
Problem: Cancer is regarded as one of the world's deadliest diseases. Machine learning and its new branch (deep learning) algorithms can facilitate the way of dealing with cancer, especially in the field of cancer prevention and detection. Traditional ways of analyzing cancer data have their limits, and cancer data is growing quickly. This makes it possible for deep learning to move forward with its powerful abilities to analyze and process cancer data. Aims: In the current study, a deep-learning medical support system for the prediction of lung cancer is presented. Methods: The study uses three different deep learning models (EfficientNetB3, ResNet50 and ResNet101) with the transfer learning concept. The three models are trained using a CT lung cancer dataset consisting of 1000 images and four different classes. The data augmentation process is applied to prevent overfitting, increase the size of the data, and enhance the training process. Score-level fusion and ensemble learning are also used to get the best performance and solve the low accuracy problem. All models were evaluated using accuracy, precision, recall, and the F1-score. Results: Experiments show the high performance of the ensemble model with 99.44% accuracy, which is better than all of the current state-of-the art methodologies. Conclusion: The current study's findings demonstrate the high accuracy and robustness of the proposed ensemble transfer deep learning using various transfer learning models
Received 08/01/2023,
Revised 01/04/2023,
Accepted 02/04/2023,
Published Online First 20/08/2023
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
References
Chugh G, Kumar S, Singh N. Survey on machine learning and deep learning applications in breast cancer diagnosis. Cognit Comput. 2021 Jan:1-20. https://doi.org/10.1007/s12559-020-09813-6
Aljuaid H, Alturki N, Alsubaie N, Cavallaro L, Liotta A. Computer-aided diagnosis for breast cancer classification using deep neural networks and transfer learning. Comput. Methods Programs Biomed. 2022 Aug 1; 223: 106951. https://doi.org/10.1016/j.cmpb.2022.106951
World Health Organization, WHO position paper on mammography screening, Geneva, Switzerland: WHO Library Cataloguing-in-Publication Data, 2014. https://apps.who.int/iris/bitstream/handle/10665/137339/?sequence=1
International Agency for Research on Cancer, “The Global Cancer Burden in 2018- framing global cancer control,” International Agency for Research on Cancer, Kuala Lumpur - Malaysia, 2018. https://pesquisa.bvsalud.org/portal/resource/pt/lis-46560?src=similardocs&utm_medium=email&utm_source=transaction
American Cancer Society, “Cancer facts and figures 2019,” American Cancer Society, 2019. https://www.cancer.org/research/cancer-facts-statistics/all-cancer-facts-figures/cancer-facts-figures-2019.html
world bladder cancer, “GLOBOCAN 2020: Bladder cancer 10th most commonly diagnosed worldwide,” world bladder cancer, Lyon , France, 2020. https://worldbladdercancer.org/news_events/globocan-2020-bladder-cancer-10th-most-commonly-diagnosed-worldwide/
American Cancer Society, “Cancer Facts & Figures 2021,” American Cancer Society, 2021. https://www.cancer.org/research/cancer-facts-statistics/all-cancer-facts-figures/cancer-facts-figures-2021.html
American Cancer Society, “Cancer Facts & Figures 2022,” American Cancer Society, 2022. https://www.cancer.org/research/cancer-facts-statistics/all-cancer-facts-figures/cancer-facts-figures-2022.html
Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2021 May; 71(3): 209-49. https://doi.org/10.3322/caac.21660
Survarachakan S, Prasad PJ, Naseem R, Frutos JP, Kumar RP, Langø T, et al. Deep learning for image-based liver analysis—A comprehensive review focusing on malignant lesions. Artif Intell Med.. 2022 Jun 9; 130: 102331. https://doi.org/10.1016/j.artmed.2022.102331
American Cancer Society, “Cancer Facts & Figures 2023,” American Cancer Society, Atlanta, 2023. https://www.cancer.org/research/cancer-facts-statistics/all-cancer-facts-figures/2023-cancer-facts-figures.html
Ravì D, Wong C, Deligianni F, Berthelot M, Andreu-Perez J, Lo B, et al. Deep learning for health informatics. IEEE J Biomed Health Inf. 2016 Dec 29;21(1):4-21. https://doi.org/10.1109/JBHI.2016.2636665
Triantafyllidis A, Kondylakis H, Katehakis D, Kouroubali A, Koumakis L, Marias K, et al. Deep learning in mHealth for cardiovascular disease, diabetes, and cancer: systematic review. JMIR mHealth and uHealth. 2022 Apr 4; 10(4): e32344. https://doi.org/10.2196/32344
Mohammed MA, Abdulkareem KH, Dinar AM, Zapirain BG. Rise of Deep Learning Clinical Applications and Challenges in Omics Data: A Systematic Review. Diagnostics. 2023 Feb 10; 13(4): 664. https://doi.org/10.3390/diagnostics13040664
Mukhlif AA, Al-Khateeb B, Mohammed MA. Incorporating a Novel Dual Transfer Learning Approach for Medical Images. Sensors. 2023 Jan; 23(2): 570. https://doi.org/10.3390/s23020570
Ahmad AS, Mayya AM. A new tool to predict lung cancer based on risk factors. Heliyon. 2020 Feb 1; 6(2): e03402. https://doi.org/10.1016/j.heliyon.2020.e03402
Dalmiglio C, Brilli L, Campanile M, Ciuoli C, Cartocci A, Castagna MG. CONUT score: a new tool for predicting prognosis in patients with advanced thyroid cancer treated with TKI. Cancers. 2022 Jan 30; 14(3): 724. https://doi.org/10.3390/cancers14030724
Huang C, Su Q, Ding Z, Zeng W, Zhou Z. A novel clinical tool to predict cancer‐specific survival in patients with primary pelvic sarcomas: A large population‐based retrospective cohort study. Cancer Med. 2023 Jan; 12(2): 1279-92. https://doi.org/10.1002/cam4.4998, https://doi.org/10.3390/ijms23031809
Asuntha A, Srinivasan A. Deep learning for lung Cancer detection and classification. Multimedia Tools Appl. 2020 Mar;79: 7731-62. https://doi.org/10.1007/s11042-019-08394-3
Benhammou Y, Achchab B, Herrera F, Tabik S. BreakHis based breast cancer automatic diagnosis using deep learning: Taxonomy, survey and insights. Neurocomputing. 2020 Jan 29; 375: 9-24. https://doi.org/10.1016/j.neucom.2019.09.044
Yurttakal AH, Erbay H, İkizceli T, Karaçavuş S. Detection of breast cancer via deep convolution neural networks using MRI images. Multimedia Tools Appl. 2020 Jun;79: 15555-73. https://doi.org/10.1007/s11042-019-7479-6
Liu T, Siegel E, Shen D. Deep learning and medical image analysis for COVID-19 diagnosis and prediction. Annu Rev Biomed Eng. 2022 Jun 6; 24: 179-201. https://doi.org/10.1146/annurev-bioeng-110220-012203
Mayya A, Khozama S. A Novel Medical Support Deep Learning Fusion Model for the Diagnosis of COVID-19. IEEE Int Conf. Adv Trends Multi-Discip. Res Innovation. 2020 Dec 30 (pp. 1-6). IEEE. https://doi.org/10.1109/ICATMRI51801.2020.9398317
Kondaveeti HK, Edupuganti P. Skin cancer classification using transfer learning. In2020 IEEE Int. Conf. Advent Trends in Multi-Discip. Res Innovation. 2020 Dec 30 (pp. 1-4). IEEE. https://doi.org/10.1109/ICATMRI51801.2020.9398388
Ma Q, Xu D. Deep learning shapes single-cell data analysis. Nat Rev Mol Cell Biol. 2022 May; 23(5): 303-4. https://doi.org/10.1038/s41580-022-00466-x
Nagarajan SM, Deverajan GG, Chatterjee P, Alnumay W, Ghosh U. Effective task scheduling algorithm with deep learning for Internet of Health Things (IoHT). Sustain Cities Soc. 2021 Aug 1;71:102945. https://doi.org/10.1016/j.scs.2021.102945
Lavanya PM, Sasikala E. Deep learning techniques on text classification using Natural language processing (NLP) in social healthcare network: A comprehensive survey. 3rd Int. Conf Signal Process Commun. 2021 May 13 (pp. 603-609). IEEE. https://doi.org/10.1109/ICSPC51351.2021.9451752
Hinton GE, Salakhutdinov RR. Reducing the dimensionality of data with neural networks. Science. 2006 Jul 28; 313(5786): 504-7. https://doi.org/10.1126/science.1127647
Hinton GE, Osindero S, Teh YW. A fast learning algorithm for deep belief nets. Neural comput. 2006 Jul 1; 18(7): 1527-54. https://doi.org/10.1162/neco.2006.18.7.1527
Sarvamangala DR, Kulkarni RV. Convolutional neural networks in medical image understanding: a survey. Evol Intell. 2022 Mar; 15(1): 1-22. https://doi.org/10.1007/s12065-020-00540-3.
He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit. 2016 (pp. 770-778). https://openaccess.thecvf.com/content_cvpr_2016/html/He_Deep_Residual_Learning_CVPR_2016_paper.html
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, et al. Going deeper with convolutions. Proc IEEE Comput Vis Pattern Recognit. 2015 (pp. 1-9). https://www.cv-foundation.org/openaccess/content_cvpr_2015/html/Szegedy_Going_Deeper_With_2015_CVPR_paper.html
Tan M, Le Q. Efficientnet: Rethinking model scaling for convolutional neural networks. Proc 36th Int Conf Mach Learn. 2019 May 24 (pp. 6105-6114). PMLR. http://proceedings.mlr.press/v97/tan19a.html
Bhatt C, Kumar I, Vijayakumar V, Singh KU, Kumar A. The state of the art of deep learning models in medical science and their challenges. Multimedia Syst. 2021 Aug; 27(4): 599-613. https://doi.org/10.1007/s00530-020-00694-1
Cao C, Liu F, Tan H, Song D, Shu W, Li W, et al. Deep learning and its applications in biomedicine. Genom Proteom Bioinform. 2018 Feb 1; 16(1): 17-32. https://doi.org/10.1016/j.gpb.2017.07.003
Selvathi D, Aarthy Poornila A. Deep learning techniques for breast cancer detection using medical image analysis. Biol. rationalized Comput. Tech Image Proc Appl. 2018: 159-86. https://doi.org/10.1007/978-3-319-61316-1_8
Khan S, Islam N, Jan Z, Din IU, Rodrigues JJ. A novel deep learning based framework for the detection and classification of breast cancer using transfer learning. Pattern Recognit Lett. 2019 Jul 1; 125: 1-6. https://doi.org/10.1016/j.patrec.2019.03.022
Mukhlif AA, Al-Khateeb B, Mohammed M. Classification of breast cancer images using new transfer learning techniques. Iraqi J Comput Sci Math. 2023 Jan 7; 4(1): 167-80. https://doi.org/10.52866/ijcsm.2023.01.01.0014
Mahbod A, Schaefer G, Wang C, Ecker R, Ellinge I. Skin lesion classification using hybrid deep neural networks. IEEE Int Conf Acoust Speech Signal Process 2019 May 12 (pp. 1229-1233). IEEE. https://doi.org/10.1109/ICASSP.2019.8683352
Samala RK, Chan HP, Hadjiiski L, Helvie MA, Richter CD, Cha KH. Breast cancer diagnosis in digital breast tomosynthesis: effects of training sample size on multi-stage transfer learning using deep neural nets. IEEE Trans Med Imaging. 2018 Sep 16; 38(3): 686-96. https://doi.org/10.1109/TMI.2018.2870343
Li X, Qin G, He Q, Sun L, Zeng H, He Z, et al. Digital breast tomosynthesis versus digital mammography: integration of image modalities enhances deep learning-based breast mass classification. Eur Radio. 2020 Feb; 30: 778-88. https://doi.org/10.1007/s00330-019-06457-5
Nagpal K, Foote D, Liu Y, Chen PH, Wulczyn E, Tan F, et al. Development and validation of a deep learning algorithm for improving Gleason scoring of prostate cancer. J Digital Med. 2019 Jun 7; 2(1): 48. https://doi.org/10.1038/s41746-019-0112-2
Ardila D, Kiraly AP, Bharadwaj S, Choi B, Reicher JJ, Peng L, et al. End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography. Nat Med. 2019 Jun; 25(6): 954-61. https://doi.org/10.1038/s41591-019-0447-x
Xie H, Yang D, Sun N, Chen Z, Zhang Y. Automated pulmonary nodule detection in CT images using deep convolutional neural networks. Pattern Recognit. 2019 Jan 1; 85: 109-19. https://doi.org/10.1016/j.patcog.2018.07.031
Coudray N, Ocampo PS, Sakellaropoulos T, Narula N, Snuderl M, Fenyö D, et al. Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning. Nat Med. 2018 Oct; 24(10): 1559-67. https://doi.org/10.1038/s41591-018-0177-5
Ech-Cherif A, Misbhauddin M, Ech-Cherif M. Deep neural network based mobile dermoscopy application for triaging skin cancer detection. 2nd Int. Conf Comput Appl Inf Secur. 2019 May 1 (pp. 1-6). IEEE. https://doi.org/10.1109/CAIS.2019.8769517.
Guo P, Xue Z, Mtema Z, Yeates K, Ginsburg O, Demarco M, et al. Ensemble deep learning for cervix image selection toward improving reliability in automated cervical precancer screening. Diagnostics. 2020 Jul 3; 10(7): 451. https://doi.org/10.3390/diagnostics10070451
Hu L, Horning MP, Banik D, Ajenifuja OK, Adepiti CA, Yeates K, et al. Deep learning-based image evaluation for cervical precancer screening with a smartphone targeting low resource settings–Engineering approach 42nd Annu Int Conf IEEE Eng Med Biol Soc. 2020 Jul 20 (pp. 1944-1949). IEEE. https://doi.org/10.1109/EMBC44109.2020.9175863
Senthilkumar G, Ramakrishnan J, Frnda J, Ramachandran M, Gupta D, Tiwari P, et al. Incorporating artificial fish swarm in ensemble classification framework for recurrence prediction of cervical cancer. IEEE Access. 2021 Jun 7; 9: 83876-86. https://doi.org/10.1109/ACCESS.2021.3087022
Alzubaidi L, Al-Amidie M, Al-Asadi A, Humaidi AJ, Al-Shamma O, Fadhel MA, et al. Novel transfer learning approach for medical imaging with limited labeled data. Cancers. 2021 Mar 30; 13(7): 1590. https://doi.org/10.3390/cancers13071590
Ashokkumar N, Meera S, Anandan P, Murthy MY, Kalaivani KS, Alahmadi TA, et al. Deep Learning Mechanism for Predicting the Axillary Lymph Node Metastasis in Patients with Primary Breast Cancer. Biomed Res Int. 2022 Aug 10; 2022. https://doi.org/10.1155/2022/8616535
Lang DM, Peeken JC, Combs SE, Wilkens JJ, Bartzsch S. Deep learning based HPV status prediction for oropharyngeal cancer patients. Cancers. 2021 Feb 13; 13(4): 786. https://doi.org/10.3390/cancers13040786
Mi W, Li J, Guo Y, Ren X, Liang Z, Zhang T, Zou H. Deep learning-based multi-class classification of breast digital pathology images. Cancer Manag Res. 2021 Jun 10: 4605-17. https://www.tandfonline.com/doi/full/10.2147/CMAR.S312608
Hu W, Li C, Li X, Rahaman MM, Ma J, Zhang Y, et al. GasHisSDB: A new gastric histopathology image dataset for computer aided diagnosis of gastric cancer. Comput Biol Med. 2022 Mar 1; 142: 105207. https://doi.org/10.1016/j.compbiomed.2021.105207.
Zhao Y, Hu B, Wang Y, Yin X, Jiang Y, Zhu X. Identification of gastric cancer with convolutional neural networks: a systematic review. Multimedia Tools Appl. 2022 Mar; 81(8): 11717-36. https://doi.org/10.1007/s11042-022-12258-8
Tung CL, Chang HC, Yang BZ, Hou KJ, Tsai HH, Tsai CY, et al. Identifying pathological slices of gastric cancer via deep learning. J Formos Med Assoc. 2022 Dec 1; 121(12): 2457-64. https://doi.org/10.1016/j.jfma.2022.05.004
Gupta S, Kalaivani S, Rajasundaram A, Ameta GK, Oleiwi AK, Dugbakie BN. Prediction performance of deep learning for colon cancer survival prediction on SEER data. Biomed Res Int. 2022 Jun 16; 2022. https://doi.org/10.1155/2022/1467070
Rajinikanth V, Kadry S, Damaševičius R, Sankaran D, Mohammed MA, Chander S. Skin melanoma segmentation using VGG-UNet with Adam/SGD optimizer: a study. 3ed Int Conf Intell Comput Instrum Control Technol. 2022 Aug 11 (pp. 982-986). IEEE.https://doi.org/10.1109/ICICICT54557.2022.9917848 .
Tripathi M. Analysis of convolutional neural network based image classification techniques. J Innov Image Process. 2021 Jun; 3(02): 100-17. https://www.academia.edu/download/76640587/03.pdf .
Hany M. Chest ctscan images dataset, Kaggle, 2020. [Online]. https://www.kaggle.com/datasets/mohamedhanyyy/chest-ctscan-images. [Accessed 1 5 2022].
Mahdi GJ. A Modified Support Vector Machine Classifiers Using Stochastic Gradient Descent with Application to Leukemia Cancer Type Dataset. Baghdad Sci J. 2023; 17(4): 1255. https://bsj.uobaghdad.edu.iq/index.php/BSJ/article/view/4283
Hasan AM, Qasim AF, Jalab HA, Ibrahim RW. Breast Cancer MRI Classification Based on Fractional Entropy Image Enhancement and Deep Feature Extraction. Baghdad Sci J. 2023 Feb. 1; 20(1): 0221. https://bsj.uobaghdad.edu.iq/index.php/BSJ/article/view/6782