IMPLEMENTATION OF TECHNOLOGY FOR IMPROVING THE QUALITY OF SEGMENTATION OF MEDICAL IMAGES BY SOFTWARE ADJUSTMENT OF CONVOLUTIONAL NEURAL NETWORK HYPERPARAMETERS
DOI:
https://doi.org/10.20535/2411-2976.12023.59-63Keywords:
convolutional neural network, image segmentation, hyperparameters, optimization algorithmAbstract
Background. The scientists have built effective convolutional neural networks in their research, but the issue of optimal setting of the hyperparameters of these neural networks remains insufficiently researched. Hyperparameters affect model selection. They have the greatest impact on the number and size of hidden layers. Effective selection of hyperparameters improves the speed and quality of the learning algorithm. It is also necessary to pay attention to the fact that the hyperparameters of the convolutional neural network are interconnected. That is why it is very difficult to manually select the effective values of hyperparameters, which will ensure the maximum efficiency of the convolutional neural network. It is necessary to automate the process of selecting hyperparameters, to implement a software mechanism for setting hyperparameters of a convolutional neural network. The author has successfully implemented the specified task.
Objective. The purpose of the paper is to develop a technology for selecting hyperparameters of a convolutional neural network to improve the quality of segmentation of medical images..
Methods. Selection of a convolutional neural network model that will enable effective segmentation of medical images, modification of the Keras Tuner library by developing an additional function, use of convolutional neural network optimization methods and hyperparameters, compilation of the constructed model and its settings, selection of the model with the best hyperparameters.
Results. A comparative analysis of U-Net and FCN-32 convolutional neural networks was carried out. U-Net was selected as the tuning network due to its higher quality and accuracy of image segmentation. Modified the Keras Tuner library by developing an additional function for tuning hyperparameters. To optimize hyperparameters, the use of the Hyperband method is justified. The optimal number of epochs was selected - 20. In the process of setting hyperparameters, the best model with an accuracy index of 0.9665 was selected. The hyperparameter start_neurons is set to 80, the hyperparameter net_depth is 5, the activation function is Mish, the hyperparameter dropout is set to False, and the hyperparameter bn_after_act is set to True.
Conclusions. The convolutional neural network U-Net, which is configured with the specified parameters, has a significant potential in solving the problems of segmentation of medical images. The prospect of further research is the use of a modified network for the diagnosis of symptoms of the coronavirus disease COVID-19, pneumonia, cancer and other complex medical diseases.
References
Long, J., Shelhamer, E., & Darrell, T. "Fully convolutional networks for semantic segmentation’. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 3431-3440, 2015.
Ronneberger, O., Fischer, P., & Brox, T. "U-net: Convolutional networks for biomedical image segmentation". In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, 2015, Part III 18. pp. 234-241, Springer International Publishing.
Raj, A. N. J., Zhu, H., Khan, A., Zhuang, Z., Yang, Z., Mahesh, V. G., & Karthik, G. (2021). "ADID-UNET—a segmentation model for COVID-19 infection from lung CT scans". PeerJ Computer Science, 7, e349.
Kalane, P., Patil, S., Patil, B. P., & Sharma, D. P. "Automatic detection of COVID-19 disease using U-Net architecture based fully convolutional network". Biomedical Signal Processing and Control, 67, 102518, 2021.
Saeedizadeh, N., Minaee, S., Kafieh, R., Yazdani, S., & Sonka, M. "COVID TV-Unet: Segmenting COVID-19 chest CT images using connectivity imposed Unet". Computer methods and programs in biomedicine update, 1, 100007, 2021.
MV, M. K., Atalla, S., Almuraqab, N., & Moonesar, I. A. "Detection of COVID-19 using deep learning techniques and cost effectiveness evaluation: a survey". Frontiers in Artificial Intelligence, 5, 107, 2022.
Uçar, M. "Automatic segmentation of COVID-19 from computed tomography images using modified U-Net model-based majority voting approach. Neural Computing and Applications", 1-12, 2022.
Liu, X., Liu, Y., Fu, W., & Liu, S. "SCTV-UNet: "A COVID-19 CT Segmentation Network Based on Attention Mechanism", 2023.
