Deep Learning Paradigms for Existing and Imminent Lung Diseases Detection: A Review

Bhavna Vohra; Sumit Mittal

doi:10.18006/2023.11(2).226.235

Authors

Bhavna Vohra M. M. Institute of Computer Technology & Business Management, Maharishi Markandeshwar (Deemed to be University), Mullana-Ambala, Haryana-133207, India https://orcid.org/0009-0004-6054-4680
Sumit Mittal M. M. Institute of Computer Technology & Business Management, Maharishi Markandeshwar (Deemed to be University), Mullana-Ambala, Haryana-133207, India https://orcid.org/0000-0003-4072-5850

DOI:

https://doi.org/10.18006/2023.11(2).226.235

Keywords:

Deep Learning, Lung diseases, Machine learning, Semi-supervised, Computed Tomography, Chest Radiographs, Prediction Models

Abstract

Diagnosis of lung diseases like asthma, chronic obstructive pulmonary disease, tuberculosis, cancer, etc., by clinicians rely on images taken through various means like X-ray and MRI. Deep Learning (DL) paradigm has magnified growth in the medical image field in current years. With the advancement of DL, lung diseases in medical images can be efficiently identified and classified. For example, DL can detect lung cancer with an accuracy of 99.49% in supervised models and 95.3% in unsupervised models. The deep learning models can extract unattended features that can be effortlessly combined into the DL network architecture for better medical image examination of one or two lung diseases. In this review article, effective techniques are reviewed under the elementary DL models, viz. supervised, semi-supervised, and unsupervised Learning to represent the growth of DL in lung disease detection with lesser human intervention. Recent techniques are added to understand the paradigm shift and future research prospects. All three techniques used Computed Tomography (C.T.) images datasets till 2019, but after the pandemic period, chest radiographs (X-rays) datasets are more commonly used. X-rays help in the economically early detection of lung diseases that will save lives by providing early treatment. Each DL model focuses on identifying a few features of lung diseases. Researchers can explore the DL to automate the detection of more lung diseases through a standard system using datasets of X-ray images. Unsupervised DL has been extended from detection to prediction of lung diseases, which is a critical milestone to seek out the odds of lung sickness before it happens. Researchers can work on more prediction models identifying the severity stages of multiple lung diseases to reduce mortality rates and the associated cost. The review article aims to help researchers explore Deep Learning systems that can efficiently identify and predict lung diseases at enhanced accuracy.

References

Abbas, Q. (2017a). Lung-deep: a computerized tool for detection of lung nodule patterns using deep learning algorithms Detection of Lung Nodules Patterns. International Journal of Advanced Computer Science and Applications, 8(10), 2017. http://dx.doi.org/10.14569/IJACSA.2017.081015. DOI: https://doi.org/10.14569/IJACSA.2017.081015

Abbas, Q. (2017b). Nodular-deep: classification of pulmonary nodules using deep neural network, International Journal of Medical Research & Health Sciences, 6(8), 111–118.

Allemani, C., Matsuda, T., Di Carlo V., et al. (2018). Global surveillance of trends in cancer survival 2000-14 (CONCORD-3): analysis of individual records for 37 513 025 patients diagnosed with one of 18 cancers from 322 population-based registries in 71 countries. The Lancet, 391(10125), 1023-1075. DOI: https://doi.org/10.1016/S0140-6736(17)33326-3

Alshmrani, G. M. M., Ni, Q., Jiang, R., Pervaiz, H., & Elshennawy, N. M. (2023). A deep learning architecture for multi-class lung diseases classification using chest X-ray (CXR) images. Alexandria Engineering Journal, 64, 923–935. https://doi.org/10.1016/j.aej.2022.10.053 DOI: https://doi.org/10.1016/j.aej.2022.10.053

Alzubaidi, L., Zhang, J., Humaidi, A. J., Duan, Y., et al. (2021). Review of deep Learning: concepts, CNN architectures, challenges, applications, future directions. Journal of Big Data, 8(1), 1-74. https://doi.org/10.1186/s40537-021-00444-8 DOI: https://doi.org/10.1186/s40537-021-00444-8

Anitha, J., Kalaiarasu, M., Kumar, N. Suresh & Sundar, G. Ram (2022). Detection and classification of lung diseases using deep Learning. AIP Conference Proceedings, 2519, 030001. https://doi.org/10.1063/5.0109980 DOI: https://doi.org/10.1063/5.0109980

Ayachi, R., Afif, M., Said, Y., & Atri, M. (2018). Strided Convolution Instead of Max Pooling for Memory Efficiency of Convolutional Neural Networks. In: M. Bouhlel, S. Rovetta, (eds) Proceedings of the 8th International Conference on Sciences of Electronics, Technologies of Information and Telecommunications (SETIT’18), Vol.1. SETIT 2018. Smart Innovation, Systems and Technologies, vol 146. Springer, Cham. https://doi.org/10.1007/978-3-030-21005-2_23 DOI: https://doi.org/10.1007/978-3-030-21005-2_23

Bayoudh, K., Hamdaoui, F., & Mtibaa, A. (2020). Hybrid COVID: a novel hybrid 2D/3D CNN based on cross‑domain adaptation approach for COVID‑19 screening from chest X‑ray images, Physical and Engineering Sciences in Medicine, 43, 1415–1431. https://doi.org/10.1007/s13246-020-00957-1 DOI: https://doi.org/10.1007/s13246-020-00957-1

Bharati, S., Podder, P., & Mondal, M. R. H. (2020). Hybrid deep Learning for detecting lung diseases from X-ray images. Informatics in Medicine Unlocked, 20, 100391. https://doi.org/10.1016/j.imu.2020.100391 DOI: https://doi.org/10.1016/j.imu.2020.100391

Chauhan, V.K., Dahiya, K., & Sharma, A. (2019). Problem formulations and solvers in linear SVM: a review. Artificial Intelligence Review, 52, 803–855. DOI: https://doi.org/10.1007/s10462-018-9614-6

Chen, M., Shi, X., Zhang, Y., Wu, D., & Guizani, M. (2021). Deep Feature Learning for Medical Image Analysis with Convolutional Autoencoder Neural Network. IEEE Transactions on Big Data, 7(4), 750-758. DOI:10.1109/TBDATA.2017.2717439. DOI: https://doi.org/10.1109/TBDATA.2017.2717439

Del Real, A.J., Dorado, F, & Durán, J. Energy Demand Forecasting Using Deep Learning: Applications for the French Grid. Energies, 13, 2242. DOI: https://doi.org/10.3390/en13092242

Di Mauro, M., Galatro, G., Fortino, G., & Liotta, A. (2021). Supervised feature selection techniques in network intrusion detection: A critical review. Engineering Applications of Artificial Intelligence, 101, 104216. https://doi.org/10.1016/ j.engappai.2021.104216 DOI: https://doi.org/10.1016/j.engappai.2021.104216

Di Mauro, M. & Galatro, G. & Liotta, A. (2020). Experimental Review of Neural-Based Approaches for Network Intrusion Management. IEEE Transactions on Network and Service Management, 17(4), 2480-2495. https://doi.org/10.1109/ TNSM.2020.3024225 DOI: https://doi.org/10.1109/TNSM.2020.3024225

Forum of International Respiratory Societies (2021). The global impact of respiratory disease. Third Edition. European Respiratory Society. Retrieved from http://firsnet.org/images/publications/ FIRS_Master_09202021.pdf

Freund, Y., & Haussler, D. (1991). Unsupervised Learning of distributions on binary vectors using two layer networks, Advances in Neural Information Processing Systems, 4, 912–919.

Gao, C., Yan J., Zhou, S., Varshney, P.K., & Liu H. (2019). Long short-term memory based deep recurrent neural networks for target tracking. Information Sciences, 502, 279– 96. DOI:10.1016/j.ins.2019.06.039. DOI: https://doi.org/10.1016/j.ins.2019.06.039

GBD Chronic Respiratory Disease Collaborators (2020). Prevalence and attributable health burden of chronic respiratory diseases, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017. The Lancet Respiratory Medicine, 8(6), 585-596.

Ghosal, S.S., Sarkar, I., & Elhallaoui, I. (2020). Lung Nodule Classification Using Convolutional Autoencoder and Clustering Augmented Learning Method (CALM), HSDM 2020 Workshop on Health Search and Data Mining.

Global Asthma Report (2018). Global Asthma Network. Retrieved from http://globalasthmareport.org/burden/burden.php

Global Tuberculosis Report (2020). World Health Organization Global Tuberculosis Program. World Health Organization. Retrieved from https://www.who.int/publications/i/item/9789240013131

Glorot, X., & Bengio, Y. (2010) Understanding the Difficulty of Training Deep Feedforward Neural Networks. Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics. Proceedings of Machine Learning Research, 9, 249-256. http://proceedings.mlr.press/v9/glorot10a.html

Goodfellow, I.J., Pouget-Abadie, J., Mirza, M, et al. (2014) Generative Adversarial Nets. Proceedings of the 27th International Conference on Neural Information Processing Systems, 2, 2672-2680. https://dl.acm.org/doi/10.5555/2969033.2969125

Gu, Y., Chi, J., Liu, J., Yang, L., Zhang, B., et al. (2021). A survey of computer-aided diagnosis of lung nodules from C.T. scans using deep Learning. Computer in Biology and Medicine, 137:104806. DOI: https://doi.org/10.1016/j.compbiomed.2021.104806

Han, C., Kitamura, Y., Kudo, A., Ichinose, A., Rundo, L. et al. (2019). Synthesizing Diverse Lung Nodules Wherever Massively: 3D Multi-Conditional GAN-based CT Image Augmentation for Object Detection. arXiv. https://doi.org/10.48550/arXiv.1906.04962 DOI: https://doi.org/10.1109/3DV.2019.00085

Hinton, G.E. (2002). Training products of experts by minimizing contrastive divergence. Neural Computation, 14, 1771–1800. DOI: https://doi.org/10.1162/089976602760128018

Hsieh, Y.J., Tseng, H.C., Chin, C.L., Shao, Y.H., & Tsai, T.Y. (2020) Based on DICOM RT Structure and Multiple Loss Function Deep Learning Algorithm in Organ Segmentation of Head and Neck Image. In: K.P. Lin, R. Magjarevic, & P. de Carvalho (Eds.), Future Trends in Biomedical and Health Informatics and Cybersecurity in Medical Devices. ICBHI 2019. IFMBE Proceedings, 74, Springer, Cham, 428-435. https://doi.org/10.1007/978-3-030-30636-6_58 DOI: https://doi.org/10.1007/978-3-030-30636-6_58

Hua, L., Hsu, H., Hidayati, S. C., Cheng, H., & Chen, J. (2015). Computer-aided classification of lung nodules on computed tomography images via deep learning technique. OncoTargets and therapy, 8, 2015-2022. DOI: https://doi.org/10.2147/OTT.S80733

Kalra, V., Kashyap, I., & Kaur, H. (2021). Machine Learning and Its Application in Monitoring Diabetes Mellitus. In B. Patil & M. Vohra (Eds.), Handbook of Research on Engineering, Business, and Healthcare Applications of Data Science and Analytics (pp. 228-288). IGI Global Publisher of Timely Knowledge. https://doi.org/10.4018/978-1-7998-3053-5.ch012 DOI: https://doi.org/10.4018/978-1-7998-3053-5.ch012

Kumar, D., Wong, A., & Clausi, D.A. (2015). Lung nodule classification using deep features in C.T. images, in 12th Conference on Computer and Robot Vision, IEEE, 2015, pp. 133–138. DOI: https://doi.org/10.1109/CRV.2015.25

Li, X., Cao, X., Guo, M., Xie, M., & Liu, X. (2020). Trends and risk factors of mortality and disability adjusted life years for chronic respiratory diseases from 1990 to 2017: a systematic analysis for the Global Burden of Disease Study 2017. BMJ, 368, 234 DOI: https://doi.org/10.1136/bmj.m234

Li, L., Ayiguli, A., Luan, Q., Yang, B. et al. (2022). Prediction and Diagnosis of Respiratory Disease by Combining Convolutional Neural Network and Bi-directional Long Short-Term Memory Methods. Frontiers in Public Health. https://doi.org/10.3389/ fpubh.2022.881234 DOI: https://doi.org/10.3389/fpubh.2022.881234

Liao, F., Liang, M., Li, Z., Hu, X., & Song, S. (2019). Evaluate the malignancy of pulmonary nodules using the 3-D deep leaky noisy-or network. IEEE transactions on neural networks and learning systems, 30(11), 3484–3495. DOI: https://doi.org/10.1109/TNNLS.2019.2892409

Liu, M., Jiang, X., Liu, Y., Zhao, F., & Zhou, H. (2020). A semi-supervised convolutional transfer neural network for 3D pulmonary nodules detection. Neurocomputing, 391, 199-209. https://doi.org/10.1016/j.neucom.2018.12.081 DOI: https://doi.org/10.1016/j.neucom.2018.12.081

Meghji, J., Mortimer, K., Agusti, A. et al. (2021). Improving lung health in low- and middle-income countries: from challenges to solutions. The Lancet, 397(10277), 928-940. DOI: https://doi.org/10.1016/S0140-6736(21)00458-X

Messay, T., Hardie, R. C., & Tuinstra, T. R. (2015). Segmentation of pulmonary nodules in computed tomography using a regression neural network approach and its application to the Lung Image Database Consortium and Image Database Resource Initiative dataset. Medical Image Analysis, 22(1), 48-62. DOI: https://doi.org/10.1016/j.media.2015.02.002

Mohamed I. (2022). Prediction of Chronic Obstructive Pulmonary Disease Stages Using Machine Learning Algorithms. International Journal of Decision Support System Technology, 14(1), 1-13. DOI: 10.4018/IJDSST.286693 DOI: https://doi.org/10.4018/IJDSST.286693

Mohapatra, R. K., Pal, M., Parija, S., Panda, G., & Dhama, K. (2022). Machine learning for the classification of breast cancer tumor: a comparative analysis. Journal of Experimental Biology and Agricultural Sciences, 10(2), 440–450. DOI: https://doi.org/10.18006/2022.10(2).440.450

Nakao, T., Hanaoka, S., Nomura, Y. et al. (2021). Unsupervised Deep Anomaly Detection in Chest Radiographs. Journal of Digital Imaging, 34, 418–427. https://doi.org/10.1007/s10278-020-00413-2 DOI: https://doi.org/10.1007/s10278-020-00413-2

Ngo, T.A., Lu, Z., & Carneiro, G. (2017). Combining Deep Learning and Level Set for the Automated Segmentation of the Left Ventricle of the Heart from Cardiac Cine Magnetic Resonance. Medical Image Analysis, 35, 159–171. https://doi.org/10.1016/j.media.2016.05.009 DOI: https://doi.org/10.1016/j.media.2016.05.009

Onishi,Y., Teramoto, A., Tsujimoto, M., Tsukamoto, T., et al. (2020). Multiplanar analysis for pulmonary nodule classification in C.T. images using deep convolutional neural network and generative adversarial networks. International Journal of Computer Assisted Radiology and Surgery, 15, 173–178. DOI: https://doi.org/10.1007/s11548-019-02092-z

Padmapriya J., & Sasilatha T., (2023). Deep Learning based multi-labelled soil classification and empirical estimation toward sustainable agriculture. Engineering Applications of Artificial Intelligence, 119, 105690. https://doi.org/10.1016/ j.engappai.2022.105690 DOI: https://doi.org/10.1016/j.engappai.2022.105690

Pandey, B., Pandey, D.K., Mishra, B.P. & Rhmann, W. (2022). A Comprehensive Survey of Deep Learning in the Field of Medical Imaging and Medical Natural Language Processing: Challenges and Research Directions. Journal of King Saud University-Computer and Information Sciences, 34(8), 5083-5099. https://doi.org/10.1016/j.jksuci.2021.01.0007 DOI: https://doi.org/10.1016/j.jksuci.2021.01.007

Pascanu, R., Gulcehre, C., Cho, K., & Bengio, Y. (2013). How to Construct Deep Recurrent Neural Networks. ArXiv. https://doi.org/10.48550/arXiv.1312.6026

Peng, H., Sun, H., & Guo, Y. (2021). 3D multi-scale deep convolutional neural networks for pulmonary nodule detection. PLoS ONE, 16(1), e0244406. https://doi.org/10.1371/ journal.pone.0244406 DOI: https://doi.org/10.1371/journal.pone.0244406

Piccialli, F., Di Somma, V., Giampaolo, F., Cuomo, S., & Fortino, G. (2021). A Survey on Deep Learning in Medicine: Why, How and When? Information Fusion, 66, 111-137. DOI: https://doi.org/10.1016/j.inffus.2020.09.006

Qin, R., Wang, Z., Jiang, L., Qiao, K., Hai, J., Chen, J., et al. (2020). Fine-grained lung cancer classification from PET and C.T. images based on multidimensional attention mechanism. Complexity, 2020:165–75. DOI: 10.1155/2020/6153657 DOI: https://doi.org/10.1155/2020/6153657

Quazi, S., Saha, R. P., & Singh, M. K. (2022). Applications of Artificial Intelligence in Healthcare. Journal of Experimental Biology and Agricultural Sciences, 10(1), 211–226. DOI: https://doi.org/10.18006/2022.10(1).211.226

Ranzato, M.A., Boureau, Y.L., & LeCun, Y. (2007). Sparse feature learning for deep belief networks. Advances in Neural Information Processing Systems, 20, 1185–1192.

Ravi, V., Narasimhan, H., Chakraborty, C., & Pham, T.D. (2022). Deep learning-based meta-classifier approach for COVID-19 classification using C.T. scan and chest X-ray images. Multimedia Systems, 28(4), 1401-1415. DOI: 10.1007/s00530-021-00826-1. DOI: https://doi.org/10.1007/s00530-021-00826-1

Rumelhart, D.E., Hinton, G.E. & Williams, R.J. (1985) Learning Internal Representations by Error Propagation. In: Rumelhart, D.E., McClelland, J.L. and the PDP Research Group, Eds., Parallel Distributed Processing: Exploration in the Microstructure of Cognition. Volume I: Foundations, MIT Press, Cambridge, MA, 318-362. DOI: https://doi.org/10.21236/ADA164453

Sharma, D., Dutta, S. & Bora, D. (2020). REGA: Real-Time Emotion, Gender, Age Detection Using CNN—A Review. The International Conference on Research in Management & Technovation, 24, 115-118. DOI: 10.15439/2020KM18. DOI: https://doi.org/10.15439/2020KM18

Smolensky, P. (1986), Information Processing in Dynamical Systems: Foundations of Harmony Theory. Chapter 6 of D.E. Rumelhart, J.L. McClelland, and the PDP Research Group, Parallel Distributed Processing: Exploration in the Microstructure of Cognition. Volume I: Foundations. Cambridge, MA: MIT Press/Bradford Books.

Sung, H., Ferlay, J., Siegel, R. L., et al. (2021). Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA: A Cancer Journal of Clinicals, 71(3), 209-249. DOI: https://doi.org/10.3322/caac.21660

Tandon, R., Agrawal, S., Chang, A., & Band, S. S. (2022). VCNet: Hybrid Deep Learning Model for Detection and Classification of Lung Carcinoma Using Chest Radiographs. Frontiers in Public Health. https://doi.org/10.3389/fpubh.2022.894920 DOI: https://doi.org/10.3389/fpubh.2022.894920

Ursuleanu, T.F., Luca, A.R., Gheorghe, L., et al. (2021). Unified Analysis Specific to the Medical Field in the Interpretation of Medical Images through the Use of Deep Learning. E-Health Telecommunication Systems and Networks, 10, 41-74. https://doi.org/10.4236/etsn.2021.102003 DOI: https://doi.org/10.4236/etsn.2021.102003

Vos, T., Lim S. S., Abbafati, C., et al (2020). GBD 2019 Diseases and Injuries Collaborators. Global burden of 369 diseases and injuries in 204 countries and territories, 1990–2019: a systematic analysis for the Global Burden of Disease Study 2019. The Lancet, 396(10258), P1204-1222.

Walsh, S.L.F., Mackintosh, J.A., Calandriello, L., Silva, M., et al. (2022). Deep Learning-based Outcome Prediction in Progressive Fibrotic Lung Disease Using High-Resolution Computed Tomography. American Journal of Respiratory and Critical Care Medicine, 206(7), 883–891. DOI: 10.1164/rccm.202112-2684OC. DOI: https://doi.org/10.1164/rccm.202112-2684OC

Wang, C., Ma, J., & Zhang, S. et al. (2022a). Development and validation of an abnormality-derived deep-learning diagnostic system for major respiratory diseases. NPJ Digital Medicine, 5(1), 124. https://doi.org/10.1038/s41746-022-00648-z DOI: https://doi.org/10.1038/s41746-022-00648-z

Wang, C., Ma, J., Shao, J., Zhang, S., Li, J. et al. (2022b). Non-Invasive Measurement Using Deep Learning Algorithm Based on Multi-Source Features Fusion to Predict PD-L1 Expression and Survival in NSCLC. Frontiers in Immunology, https://doi.org/10.3389/fimmu.2022.828560 DOI: https://doi.org/10.3389/fimmu.2022.828560

Wang, C., Ma, J., Shao, J., Zhang, S., Liu, Z. et al. (2022c). Predicting EGFR and PD-L1 Status in NSCLC Patients Using Multitask A.I. System Based on C.T. Images. Frontiers in Immunology, https://doi.org/10.3389/fimmu.2022.813072 DOI: https://doi.org/10.3389/fimmu.2022.813072

Wang, D., Zhang, Y., Zhang, K., & Wang, L. (2020). FocalMix: semi-supervised Learning for 3Dmedical image detection, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 3950–3959. http://doi.org/10.1109/CVPR42600.2020.00401 DOI: https://doi.org/10.1109/CVPR42600.2020.00401

Wang, H., Naghavi, M., Allen, C., et al (2016). GBD 2015 Mortality and Causes of Death Collaborators. Global, regional, and national life expectancy, all-cause mortality, and cause-specific mortality for 249 causes of death, 1980–2015: A systematic analysis for the Global Burden of Disease Study 2015. The Lancet, 388(10053), 1459-1544.

Wang, J., Ding, H., Bidgoli, F.A., Zhou, B., Iribarren, C., & Molloi, S. (2017). Detecting Cardiovascular Disease from Mammograms with Deep Learning. IEEE Transactions on Medical Imaging, 36, 1172–1181, https://doi.org/10.1109/TMI.2017.265548 DOI: https://doi.org/10.1109/TMI.2017.2655486

Wang, W., & Chakraborty, G. (2019). Evaluation of malignancy of lung nodules from C.T. image using recurrent neural network, IEEE International Conference on Systems, Man and Cybernetics (SMC), Bari, Italy, pp. 2992–2997, https://doi.org/10.1109/ SMC.2019.8913885 DOI: https://doi.org/10.1109/SMC.2019.8913885

World Health Organization. Indoor air pollution and household energy (2021). Retrieved from https://www.who.int/heli/risks/ indoorair/indoorair/en/

World Health Organization. The top 10 causes of death (2020). Retrieved from https://www.who.int/news-Room/factsheets/detail/ the-top-10-causes-of-death

Xie, Y., Zhang, J., Xia, Y. (2019). Semi-supervised adversarial model for benign-malignant lung nodule classification on chest C.T. Medical Image Analysis, 57, 237–248. DOI: 10.1016/j.media.2019.07.004. DOI: https://doi.org/10.1016/j.media.2019.07.004

Zhang, J., Xia, Y., Zeng, H., & Zhang, Y. (2018). NODULe: combining constrained multi-scaleLoG filters with densely dilated 3D deep convolutional neural network for pulmonary nodule detection, Neurocomputing, 317, 159– 167. DOI: https://doi.org/10.1016/j.neucom.2018.08.022

Zhao, D., Zhu, D., Lu, J., Luo, Y., & Zhang, G. (2018). Synthetic medical images using F&BGAN for improved lung nodules classification by multi-scale VGG16, Symmetry, 10, 519. DOI: https://doi.org/10.3390/sym10100519