一种CNN-Transformer网络在皮肤镜图像分割上的应用
作者:
作者单位:

作者简介:

通讯作者:

基金项目:

国家自然科学基金面上项目(No.61772295;No.61572270;No.61173056);重庆市科学技术局项目(No.cstc2021jsyj-yzysbA0042);重庆市教育委员会科技攻关计划项目(No.KJZD-M202000501);重庆市技术创新与应用开发专项普通项目(No.cstc2020jscx-lyjsA0063)


Application of CNN Transformer Network in Dermoscopy Image Segmentation
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
    摘要:

    【目的】针对皮肤病变图像存在皮损形状不规则、边界模糊以及毛发伪影等问题,提出了一种将CNN和Transformer相结合的图像分割算法。【方法】首先对皮肤病变图像进行去毛发预处理,减少毛发噪声对结果的影响,然后构建CNN和Transformer结合的分割模型,采用Resnet作为特征提取主干网络,将提取到的特征图序列作为Transformer的输入,在Transformer中加入了新的结构边界注意门以提取足够的局部细节来处理模糊边界,最后采用DenseASPP模块增强特征表示和处理多尺度信息,并且提出一种改进了的损失函数,以便在计算损失函数的同时使得模型能关注边界区域部分。【结果】提出的算法在ISIC2017数据集上的Dice指数值以及Jaccard指数值分别为0.854 534和0.767 901,在ISIC2018数据集上的Dice指数值以及Jaccard指数值分别为0.908 548和0.843 689,与其他算法相比提出的算法对图像的分割效果相对较好。【结论】实验结果证明了所提算法在皮肤病变图像上进行的图像分割是有效的。

    Abstract:

    [Purposes] Aiming at the irregular shape, blurred boundaries and hair artifacts of skin lesions in skin lesion images, it proposes a skin lesion segmentation algorithm combining CNN and Transformer. [Methods] Firstly, the skin lesion image was pre-treated for hair removal to reduce the influence of hair noise on the result, and then a segmentation model combining CNN and Transformer was constructed, using Resnet as the backbone feature extraction network to extract features, and the extracted feature map sequence was used as the input of Transformer, and a new structural boundary attention gate was added to the Transformer to extract enough local details to process the blurry boundary. Finally, The DeanseASPP enhanced feature is used to represent and process multi-scale information, and an improved loss function is proposed, the purpose of which is to make the model focus on the boundary region part when calculating the loss function. [Findings] The experimental results show that the dice value and JI value are 0.854 534 and 0.767 901 on the ISIC2017 dataset, and 0.908 548 and 0.843 689 on the ISIC2018 dataset, respectively, which achieves good results compared with other advanced models. [Conclusions] Its effectiveness is proved by comparing with different models and showing the effect.

    参考文献
    相似文献
    引证文献
引用本文

董玉民,卫力行.一种CNN-Transformer网络在皮肤镜图像分割上的应用[J].重庆师范大学学报自然科学版,2023,(2):126-134

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2023-05-22