COVID-19 diagnosis based on CT scan image segmentation using multi-scale convolutional neural network
Riadh Ayachi
Universit of Monastir
Mouna Afif
Yahia said
Abdessalem Ben Abdelali
DOI: https://doi.org/10.59429/ifr.v2i1.6552
Keywords: COVID-19; automatic diagnosis; multi-scale network; convolutional neural network; CT scan images segmentation
Abstract
The COVID-19 pandemic continues to pose significant health challenges worldwide. While traditional methods like Reverse Transcription Polymerase Chain Reaction (RT-PCR) are widely used for diagnosis, they often suffer from limitations in speed and accessibility. This chapter proposes an automatic COVID-19 diagnosis technique using CT scan image segmentation, offering a promising alternative for early detection. The proposed method leverages Convolutional Neural Networks (CNNs), enhanced with a multi-scale approach, to capture more detailed semantic features and achieve high-quality segmentation despite challenges such as low image resolution, varying infection characteristics, and limited training data. To address the data scarcity issue, various data augmentation techniques, including scale variation, translation, and rotation, were applied to enhance the model's performance. The proposed CNN was evaluated using the COVID-19 CT dataset, achieving an overall accuracy of 96.85%, with COVID-19 sensitivity at 93.31%, Common Pneumonia sensitivity at 92.93%, and a true negative rate of 97.82%. These results demonstrate the effectiveness and efficiency of the proposed method in detecting COVID-19 at an early stage, reducing the need for human intervention, and accelerating the diagnostic process. Compared to existing methods, this approach offers significant improvements in accuracy and reliability, making it a valuable tool in the ongoing fight against the pandemic.
Author Biographies
Mouna Afif
Laboratory of Electronics and Microelectronics, Faculty of Sciences of Monastir, University of Monastir, Monastir, Tunisia
Yahia said
Electrical Engineering Department, College of Engineering, Northern Border University, Arar, Saudi Arabia
Abdessalem Ben Abdelali
Laboratory of Electronics and Microelectronics, Faculty of Sciences of Monastir, University of Monastir, Monastir, Tunisia
References
1.WHO Coronavirus (COVID-19) Dashboard. Available at: https://covid19.who.int/ last accessed 01/04/2021.
2.Ai, Tao, Zhenlu Yang, Hongyan Hou, Chenao Zhan, Chong Chen, Wenzhi Lv, Qian Tao, Ziyong Sun, and Liming Xia. "Correlation of chest CT and RT-PCR testing for coronavirus disease 2019 (COVID-19) in China: a report of 1014 cases." Radiology 296, no. 2 (2020): E32-E40.
3.Fang, Yicheng, Huangqi Zhang, Jicheng Xie, Minjie Lin, Lingjun Ying, Peipei Pang, and Wenbin Ji. "Sensitivity of chest CT for COVID-19: comparison to RT-PCR." Radiology 296, no. 2 (2020): E115-E117.
4.Afif, Mouna, Riadh Ayachi, Yahia Said, and Mohamed Atri. "Deep learning based application for indoor scene recognition." Neural Processing Letters (2020): 1-11.
5.Ayachi, Riadh, Yahia Said, and Mohamed Atri. "A Convolutional Neural Network to Perform Object Detection and Identification in Visual Large-Scale Data." Big Data 9, no. 1 (2021): 41-52.
6.Minaee, Shervin, Yuri Y. Boykov, Fatih Porikli, Antonio J. Plaza, Nasser Kehtarnavaz, and Demetri Terzopoulos. "Image segmentation using deep learning: A survey." IEEE Transactions on Pattern Analysis and Machine Intelligence (2021).
7.Renard, Félix, Soulaimane Guedria, Noel De Palma, and Nicolas Vuillerme. "Variability and reproducibility in deep learning for medical image segmentation." Scientific Reports 10, no. 1 (2020): 1-16.
8.He, Kaiming, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. "Spatial pyramid pooling in deep convolutional networks for visual recognition." IEEE transactions on pattern analysis and machine intelligence 37, no. 9 (2015): 1904-1916.
9.Milletari, Fausto, Nassir Navab, and Seyed-Ahmad Ahmadi. "V-net: Fully convolutional neural networks for volumetric medical image segmentation." In 2016 fourth international conference on 3D vision (3DV), pp. 565-571. IEEE, 2016.
10.Kang Zhang, Xiaohong Liu, Jun Shen, Zhihuan Li, Ye Sang, Xingwang Wu, Yunfei Zha, Wenhua Liang, Chengdi Wang, Ke Wang, Linsen Ye, Ming Gao, Zhongguo Zhou, Liang Li, Jin Wang, Zehong Yang, Huimin Cai, Jie Xu, Lei Yang, Wenjia Cai, Wenqin Xu, Shaoxu Wu, Wei Zhang, Shanping Jiang, Lianghong Zheng, Xuan Zhang, Li Wang, Liu Lu, Jiaming Li, Haiping Yin, Winston Wang, Oulan Li, Charlotte Zhang, Liang Liang, Tao Wu, Ruiyun Deng, Kang Wei, Yong Zhou, Ting Chen, Johnson Yiu-Nam Lau, Manson Fok, Jianxing He, Tianxin Lin, Weimin Li, Guangyu Wang,. Clinically applicable ai system for accurate diagnosis, quantitative measurements, and prognosis of covid-19 pneumonia using computed tomography. Cell, 2020.
11.Shi, Feng, Jun Wang, Jun Shi, Ziyan Wu, Qian Wang, Zhenyu Tang, Kelei He, Yinghuan Shi, and Dinggang Shen. "Review of artificial intelligence techniques in imaging data acquisition, segmentation and diagnosis for covid-19." IEEE reviews in biomedical engineering (2020).
12.Ter-Sarkisov, Aram. "Covid-ct-mask-net: Prediction of covid-19 from ct scans using regional features." medRxiv (2020).
13.He, Kaiming, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. "Mask r-cnn." In Proceedings of the IEEE international conference on computer vision, pp. 2961-2969. 2017.
14.Ren, Shaoqing, Kaiming He, Ross Girshick, and Jian Sun. "Faster r-cnn: Towards real-time object detection with region proposal networks." arXiv preprint arXiv:1506.01497 (2015).
15.Alom, Md Zahangir, M. M. Rahman, Mst Shamima Nasrin, Tarek M. Taha, and Vijayan K. Asari. "Covid_mtnet: Covid-19 detection with multi-task deep learning approaches." arXiv preprint arXiv:2004.03747 (2020).
16.Szegedy, Christian, Vincent Vanhoucke, Sergey Ioffe, Jon Shlens, and Zbigniew Wojna. "Rethinking the inception architecture for computer vision." In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2818-2826. 2016.
17.Kai Gao, Jianpo Su, Zhongbiao Jiang, Ling-Li Zeng, Zhichao Feng, Hui Shen, Pengfei Rong, Xin Xu, Jian Qin, Yuexiang Yang, Wei Wang, Dewen Hu,. "Dual-branch combination network (DCN): Towards accurate diagnosis and lesion segmentation of COVID-19 using CT images." Medical image analysis 67 (2021): 101836.
18.Ronneberger, Olaf, Philipp Fischer, and Thomas Brox. "U-net: Convolutional networks for biomedical image segmentation." In International Conference on Medical image computing and computer-assisted intervention, pp. 234-241. Springer, Cham, 2015.
19.He, Kaiming, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. "Deep residual learning for image recognition." In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770-778. 2016.
20.Dong Yang, Ziyue Xu, Wenqi Li, Andriy Myronenko, Holger R. Roth, Stephanie Harmon, Sheng Xu, Baris Turkbey, Evrim Turkbey, Xiaosong Wang, Wentao Zhu, Gianpaolo Carrafiello, Francesca Patella, Maurizio Cariati, Hirofumi Obinata, Hitoshi Mori, Kaku Tamura, Peng An, Bradford J. Wood, Daguang Xu,. "Federated semi-supervised learning for COVID region segmentation in chest CT using multi-national data from China, Italy, Japan." Medical image analysis 70 (2021): 101992.
21.Loshchilov I, Hutter F Decoupled weight decay regularization. In: seventh international conference on learning representations (ICLR). Ernest N. Morial Convention Center, New Orleans, USA, (2019).
22.Ahmed, Imran, Abdellah Chehri, and Gwanggil Jeon. "A Sustainable Deep Learning-Based Framework for Automated Segmentation of COVID-19 Infected Regions: Using U-Net with an Attention Mechanism and Boundary Loss Function." Electronics 11, no. 15 (2022): 2296.
23.COVID-19 CT scans from Italian Society of Medical and Interventional Radiology. Available at: https://sirm.org/category/senza-categoria/covid-19/. Last accessed: 02/13/2023.
24.COVID-19 pneumonia. Available at: https://radiopaedia.org/playlists/25887/. Last accessed: 02/13/2023.
25.COVID-19 CT segmentation dataset. Available at: http://medicalsegmentation.com/covid19/. Last accessed: 02/13/2023.
26.Suri, Jasjit S., Sushant Agarwal, Gian Luca Chabert, Alessandro Carriero, Alessio Paschè, Pietro SC Danna, Luca Saba et al. "COVLIAS 1.0 Lesion vs. MedSeg: An Artificial Intelligence Framework for Automated Lesion Segmentation in COVID-19 Lung Computed Tomography Scans." Diagnostics 12, no. 5 (2022): 1283.
27.Zhao, Hengshuang, Jianping Shi, Xiaojuan Qi, Xiaogang Wang, and Jiaya Jia. "Pyramid scene parsing network." In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2881-2890. 2017.
28.Punn, Narinder Singh, and Sonali Agarwal. "Chs-net: A deep learning approach for hierarchical segmentation of covid-19 via ct images." Neural Processing Letters 54, no. 5 (2022): 3771-3792.
29.Amara, Kahina, Ali Aouf, Hoceine Kennouche, A. Oualid Djekoune, Nadia Zenati, Oussama Kerdjidj, and Farid Ferguene. "COVIR: A virtual rendering of a novel NN architecture O-Net for COVID-19 Ct-scan automatic lung lesions segmentation." Computers & Graphics 104 (2022): 11-23.
30.Enshaei, Nastaran, Anastasia Oikonomou, Moezedin Javad Rafiee, Parnian Afshar, Shahin Heidarian, Arash Mohammadi, Konstantinos N. Plataniotis, and Farnoosh Naderkhani. "COVID-rate: an automated framework for segmentation of COVID-19 lesions from chest CT images." Scientific Reports 12, no. 1 (2022): 1-18.
31.Ayachi, Riadh, Mouna Afif, Yahia Said, and Mohamed Atri. "Strided convolution instead of max pooling for memory efficiency of convolutional neural networks." In Proceedings of the 8th International Conference on Sciences of Electronics, Technologies of Information and Telecommunications (SETIT’18), Vol. 1, pp. 234-243. Springer International Publishing, 2020.
32.Abraham, Nabila, and Naimul Mefraz Khan. "A novel focal tversky loss function with improved attention u-net for lesion segmentation." In 2019 IEEE 16th international symposium on biomedical imaging (ISBI 2019), pp. 683-687. IEEE, 2019.
33.Afshar, Parnian, Anastasia Oikonomou, Farnoosh Naderkhani, Pascal N. Tyrrell, Konstantinos N. Plataniotis, Keyvan Farahani, and Arash Mohammadi. "3D-MCN: a 3D multi-scale capsule network for lung nodule malignancy prediction." Scientific reports 10, no. 1 (2020): 1-11.
34.Yao, Yuqin. "Image segmentation based on Sobel edge detection." In 2016 5th International Conference on Advanced Materials and Computer Science (ICAMCS 2016), pp. 141-144. Atlantis Press, 2016.
35.Casaca, Wallace, Luis Gustavo Nonato, and Gabriel Taubin. "Laplacian coordinates for seeded image segmentation." In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 384-391. 2014.
36.Fang, Yicheng, Huangqi Zhang, Jicheng Xie, Minjie Lin, Lingjun Ying, Peipei Pang, and Wenbin Ji. "Sensitivity of chest CT for COVID-19: comparison to RT-PCR." Radiology 296, no. 2 (2020): E115-E117.
37.Zheng, Bingbing, Yaoqi Liu, Yu Zhu, Fuli Yu, Tianjiao Jiang, Dawei Yang, and Tao Xu. "MSD-Net: Multi-scale discriminative network for COVID-19 lung infection segmentation on CT." Ieee Access 8 (2020): 185786-185795.
38.Afif, Mouna, Riadh Ayachi, Yahia Said, and Mohamed Atri. "Deep learning-based technique for lesions segmentation in CT scan images for COVID-19 prediction." Multimedia Tools and Applications 82, no. 17 (2023): 26885-26899.
39.Liu, Xiangbin, Ying Liu, Weina Fu, and Shuai Liu. "SCTV-UNet: a COVID-19 CT segmentation network based on attention mechanism." Soft Computing (2023): 1-11.
40.Newson, Kiri S., David M. Benoit, and Andrew W. Beavis. "Encoder-decoder convolutional neural network for simple CT segmentation of COVID-19 infected lungs." PeerJ Computer Science 10 (2024): e2178.
41.Moosavi, Abdoulreza S., Ashraf Mahboobi, Farzin Arabzadeh, Nazanin Ramezani, Helia S. Moosavi, and Golbarg Mehrpoor. "Segmentation and classification of lungs CT-scan for detecting COVID-19 abnormalities by deep learning technique: U-Net model." Journal of Family Medicine and Primary Care 13, no. 2 (2024): 691-698.