浏览全部资源
扫码关注微信
Published： 16 March 2024 ，
移动端阅览
秦俊， 卢婷岚， 纪柏， 李雨晴. 2024. 面向低剂量CT的牙齿分割网络. 中国图象图形学报， 29(03):0686-0696
Qin Jun， Lu Tinglan， Ji Bai， Li Yuqing. 2024. Tooth segmentation network for low-dose CT. Journal of Image and Graphics， 29(03):0686-0696
目的
2
锥形束计算机断层扫描（cone beam computer tomography， CBCT）已成为口腔诊疗领域中最常用的一项医学影像技术。由于CBCT图像本身对比度低且牙齿形状复杂，在进行牙齿分割时容易导致分割边界模糊、牙齿根部错误分割的问题。现有方法往往无法达到预期效果，并且基于深度学习的分割网络在分割精度等性能提升到一定程度后存在生梯度爆炸、过拟合以及无法关注图像全局信息等限制。然而，牙齿分割在医生制定诊断和治疗计划方面至关重要。为了应对这一问题，提出了一种名为MF-CA Net的牙齿分割模型，以提高牙齿分割的准确性和鲁棒性。
方法
2
MF-CA Net模型引入了多尺度特征提取模块（multi-scale feature extraction module， MFEM）和CA（coordinate attention）注意力机制，这些模块使网络能够准确地捕捉感兴趣的牙齿区域，并提取丰富而密集的多尺度特征信息，从而有效地指导分割任务。特别是在牙根分割方面，这些模块能够显著提高分割的精度。为了进一步提升分割算法的性能，还引入了联合损失函数，该损失函数综合考虑了像素级、局部级和全局级3个方向的牙齿边缘分割，以提高算法的准确性和稳健性。
结果
2
实验在数据集上对MF-CA Net模型与6种主流方法进行了比较。实验结果表明，相较于其他分割方法，MF-CA Net模型在各项评价指标上都取得了显著的提升。尽管在精度（accuracy）指标上稍低于DeeplabV3+，但在Dice评价指标上达到了0.949 5的高分数，相比PyConvU-Net提高了4%，相对于DeeplabV3+提高了约4%，对比U-Net提高了约16%。此外，平均交并比（mean intersection-over-union，mIoU）指标提升了3%～11%，F2值提升了5%。
结论
2
本文提出的MF-CA Net网络模型可以实现对牙齿的精确分割。
Objective
2
The field of dentistry can be developed and improved with the mutual penetration and integration of computer technology and modern dentistry. Cone beam computed tomography （CBCT） has become one of the most commonly used medical imaging techniques in dental diagnoses and treatments. CBCT has the advantages of low radiation dosage， simple operation， and low cost. However， the noise and artifacts of CBCT are more intense than those of conventional CT， and fuzzy tooth boundaries will affect doctors’ diagnoses and subsequent treatments. In oral diagnoses and treatments， doctors usually need to manually segment the tooth model in CBCT to formulate subsequent treatment plans. However， this method is time-consuming and labor-intensive， and the segmentation results of the teeth are also significantly affected by doctors’ subjective factors. In addition， the existing network method often fails to achieve the expected results. The segmentation network based on deep learning also relatively exists in the segmentation accuracy and other performance after network segmentation to improve gradient explosion， overfitting， and over-expression. Limitations include gradient explosion， overfitting， and the inability to focus on global image information. Therefore， people have been working to find a dental segmentation method with high automation and high accuracy. To address this problem， a dental segmentation model called multi scale feature extraction module and coordinate attention （CA） mechanism network （MF-CA Net） is proposed， which uses a series of innovative methods to improve the accuracy and robustness of dental segmentation.
Method
2
The MF-CA Net network uses the multi-scale feature extraction module （MFEM） to extract features at different scales of images and utilizes the CA attention mechanism that is currently excelling in improving network performance. MFEM uses four different convolution kernels for convolution， enabling the extraction of multi-scale features and facilitating the network to learn markedly robust representations. Meanwhile， dilation convolution uses four dilation rates to further increase the receptive field， enabling the network to obtain significantly detailed information and refine important features. The CA attention mechanism calculates the spatial and channel attention weights in the input feature maps. It adaptively weights the feature map， emphasizing more representative local structures and global contextual information. By embedding positional information into the channel attention， the CA mechanism assists the network in accurately localizing and identifying the objects of interest. These modules enable the network to accurately determine the tooth region of interest and extract extensive and dense multi-scale feature information to effectively guide the segmentation task. For tooth root segmentation， these modules can significantly improve the accuracy of segmentation. To further improve the performance of the segmentation algorithm， the MF-CA Net network model also uses structural similarity to construct the boundary loss function. Moreover， the algorithm uses a combination of the Dice， binary cross-entropy， and structural similarity （SSIM） loss functions as final loss function. The Dice loss function is used to compute the similarity between two sets of images， whereas the cross-entropy loss function is used to predict the segmentation result and pixels corresponding to the real segmentation result. This loss function integrates tooth edge segmentation in three directions， namely， pixel， local， and global levels， to improve the accuracy and robustness of the algorithm.
Result
2
To more accurately evaluate the performance of the proposed model in tooth segmentation， Dice similarity coefficient， mean intersection to merger ratio （mIoU）， accuracy， recall， precision， and F2 score are used as evaluation metrics. This study compares the MF-CA Net model and six mainstream methods on the dataset. Experimental results show that the MF-CA Net model has significant improvement in most of the evaluation metrics compared with other segmentation methods. Although MF-CA Net is slightly lower than DeeplabV3+ in accuracy metrics， it achieves a high score of 0.949 5 in the Dice evaluation metrics， which is an improvement of 4% compared with PyConvU-Net， about 4% compared with DeeplabV3+， and about 16% compared with U-Net. In addition， the mIoU metric improves from 3% to nearly 11%. Precision value reaches 0.942 1， which is a 7% improvement compared with UNET++. The recall metric reaches 0.968 7， which is an 8% improvement compared with the UNET network. Lastly， the F2 metric reaches 0.954 3， which is a 5% improvement compared with the Res-UNet value. Results fully demonstrate the superiority of the MF-CA network model in tooth segmentation.
Conclusion
2
The proposed MF-CA network model successfully solves the difficult problem of tooth segmentation in CBCT images by introducing a multiscale feature extraction module， an attention mechanism， and a hybrid loss function. Many experimental results verify the proposed model’s superiority in accurate tooth segmentation. Lastly， the proposed model is expected to be widely used in dental diagnoses and treatments， which is significant in oral diagnoses and treatments.
深度学习锥形束计算机断层扫描（CBCT）牙齿分割注意力机制多尺度信息损失函数分割精度
deep learningcone beam computed tomography（CBCT）tooth segmentationattention mechanismmulti-scale informationloss functionsegmentation accuracy
Chen L C， Papandreou G， Kokkinos I， Murphy K and Yuille A L. 2018. DeepLab： semantic image segmentation with deep convolutional nets， atrous convolution， and fully connected CRFs. IEEE Transactions on Pattern Analysis and Machine Intelligence， 40（4）： 834-848 ［DOI： 10.1109/TPAMI.2017.2699184http://dx.doi.org/10.1109/TPAMI.2017.2699184］
Chung M， Lee M， Hong J， Park S， Lee J， Lee J， Yang I H， Lee J and Shin Y G. 2020. Pose-aware instance segmentation framework from cone beam CT images for tooth segmentation. Computers in Biology and Medicine， 120： #103720 ［DOI： 10.1016/j.compbiomed.2020.103720http://dx.doi.org/10.1016/j.compbiomed.2020.103720］
Cui Z M， Li C J and Wang W P. 2019. ToothNet： automatic tooth instance segmentation and identification from cone beam CT images//Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition （CVPR）. Long Beach， USA： IEEE： 6361-6370 ［DOI： 10.1109/CVPR.2019.00653http://dx.doi.org/10.1109/CVPR.2019.00653］
Gan Y Z， Xia Z Y， Xiong J， Li G L and Zhao Q F. 2018. Tooth and alveolar bone segmentation from dental computed tomography images. IEEE Journal of Biomedical and Health Informatics， 22（1）： 196-204 ［DOI： 10.1109/JBHI.2017.2709406http://dx.doi.org/10.1109/JBHI.2017.2709406］
Gan Y Z， Xia Z Y， Xiong J， Zhao Q F， Hu Y and Zhang J W. 2015. Toward accurate tooth segmentation from computed tomography images using a hybrid level set model. Medical Physics， 42（1）： 14-27 ［DOI： 10.1118/1.4901521http://dx.doi.org/10.1118/1.4901521］
Gao H and Chae O. 2010. Individual tooth segmentation from CT images using level set method with shape and intensity prior. Pattern Recognition， 43（7）： 2406-2417 ［DOI： 10.1016/j.patcog.2010.01.010http://dx.doi.org/10.1016/j.patcog.2010.01.010］
He K M， Zhang X Y， Ren S Q and Sun J. 2016. Deep residual learning for image recognition//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas， USA： IEEE： 770-778 ［DOI： 10.1109/CVPR.2016.90http://dx.doi.org/10.1109/CVPR.2016.90］
Ji D X， Ong S H and Foong K W C. 2014. A level-set based approach for anterior teeth segmentation in cone beam computed tomography images. Computers in Biology and Medicine， 50： 116-128 ［DOI： 10.1016/j.compbiomed.2014.04.006http://dx.doi.org/10.1016/j.compbiomed.2014.04.006］
Koch T L， Perslev M， Igel C and Brandt S S. 2019. Accurate segmentation of dental panoramic radiographs with U-Nets//2019 IEEE 16th International Symposium on Biomedical Imaging （ISBI 2019）. Venice， Italy： IEEE： 15-19 ［DOI： 10.1109/ISBI.2019.8759563http://dx.doi.org/10.1109/ISBI.2019.8759563］
Li C Y， Fan Y X and Cai X D. 2021. PyConvU-Net： a lightweight and multiscale network for biomedical image segmentation. BMC Bioinformatics， 22（1）： #14 ［DOI： 10.1186/s12859-020-03943-2http://dx.doi.org/10.1186/s12859-020-03943-2］
Long J， Shelhamer E and Darrell T. 2015. Fully convolutional networks for semantic segmentation//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston， USA： IEEE： 3431-3440 ［DOI： 10.1109/CVPR.2015.7298965http://dx.doi.org/10.1109/CVPR.2015.7298965］
Ronneberger O， Fischer P and Brox T. 2015. U-Net： convolutional networks for biomedical image segmentation//Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention. Munich， Germany： Springer： 234-241 ［DOI： 10.1007/978-3-319-24574-4_28http://dx.doi.org/10.1007/978-3-319-24574-4_28］
Wang Z， Simoncelli E P and Bovik A C. 2003. Multiscale structural similarity for image quality assessment//Proceedings of the 37th Asilomar Conference on Signals， Systems and Computers. Pacific Grove， USA： IEEE： 1398-1402 ［DOI： 10.1109/ACSSC.2003.1292216http://dx.doi.org/10.1109/ACSSC.2003.1292216］
Wirtz A， Mirashi S G and Wesarg S. 2018. Automatic teeth segmentation in panoramic X-ray images using a coupled shape model in combination with a neural network//Proceedings of the 21st International Conference on Medical Image Computing and Computer Assisted Intervention. Granada， Spain： Springer： 712-719 ［DOI： 10.1007/978-3-030-00937-3_81http://dx.doi.org/10.1007/978-3-030-00937-3_81］
Xia Z Y， Gan Y Z， Chang L C， Xiong J and Zhao Q F. 2017. Individual tooth segmentation from CT images scanned with contacts of maxillary and mandible teeth. Computer Methods and Programs in Biomedicine， 138： 1-12 ［DOI： 10.1016/j.cmpb.2016.10.002http://dx.doi.org/10.1016/j.cmpb.2016.10.002］
Xu L J， Zhang J Y， Huang Z H and Wang X Z. 2022. Successful individualized endodontic treatment of severely curved root canals in a mandibular second molar： a case report. World Journal of Clinical Cases， 10（14）： 4632-4639 ［DOI： 10.12998/wjcc.v10.i14.4632http://dx.doi.org/10.12998/wjcc.v10.i14.4632］
Zhang W J. 2011. Algorithms of 3D segmentation and reconstruction based on teeth CBCT images//Communication Systems and Information Technology： Selected Papers from the 2011 International Conference on Electric and Electronics. Nanchang， China： Springer： 713-720 ［DOI： 10.1007/978-3-642-21762-3_93http://dx.doi.org/10.1007/978-3-642-21762-3_93］
Zhang Z X， Liu Q J and Wang Y H. 2018. Road extraction by deep residual U-Net. IEEE Geoscience and Remote Sensing Letters， 15（5）： 749-753 ［DOI： 10.1109/LGRS.2018.2802944http://dx.doi.org/10.1109/LGRS.2018.2802944］
Zhao Y， Li P C， Gao C Q， Liu Y， Chen Q Y， Yang F and Meng D Y. 2020. TSASNet： tooth segmentation on dental panoramic X-ray images by two-stage attention segmentation network. Knowledge-Based Systems， 206： #106338 ［DOI： 10.1016/j.knosys.2020.106338http://dx.doi.org/10.1016/j.knosys.2020.106338］
Zhou T， Dong Y L， Huo B Q， Liu S and Ma Z J. 2021. U-Net and its applications in medical image segmentation： a review. Journal of Image and Graphics， 26（9）： 2058-2077
周涛， 董雅丽， 霍兵强， 刘珊， 马宗军. 2021. U-Net网络医学图像分割应用综述. 中国图象图形学报， 26（9）： 2058-2077 ［DOI： 10.11834/jig.200704http://dx.doi.org/10.11834/jig.200704］
Zhou Z W， Siddiquee M M R， Tajbakhsh N and Liang J M. 2018. UNet++： a nested U-Net architecture for medical image segmentation//4th International Workshop， DLMIA 2018， and 8th International Workshop on Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support. Granada， Spain： Springer： 3-11 ［DOI： 10.1007/978-3-030-00889-5_1http://dx.doi.org/10.1007/978-3-030-00889-5_1］
Zhu Y and Li X. 2023. A survey of medical image captioning technique： encoding， decoding and latest advance. Journal of Image and Graphics， 28（7）： 1990-2010
朱翌， 李秀. 2023. 医学图像描述综述： 编码、解码及最新进展. 中国图象图形学报， 28（7）： 1990-2010 ［DOI： 10.11834/jig.211021http://dx.doi.org/10.11834/jig.211021］
相关文章
相关作者
相关机构
京公网安备11010802024621