Journal of Jilin University(Engineering and Technology Edition) ›› 2022, Vol. 52 ›› Issue (3): 648-656.doi: 10.13229/j.cnki.jdxbgxb20200813

Previous Articles    

Dual⁃branch hybrid attention decision net for diabetic retinopathy classification

Ji-hong OUYANG(),Ze-qi GUO,Si-guang LIU()   

  1. College of Computer Science and Technology,Jilin University,Changchun 130012,China
  • Received:2020-10-26 Online:2022-03-01 Published:2022-03-08
  • Contact: Si-guang LIU E-mail:ouyj@jlu.edu.cn;lsgmliss@163.com

Abstract:

In order to address the challenges caused by limited medical resources in large-scale Diabetic Retinopathy (DR) screening process, a dual-branch hybrid attention decision net (BiRAD-Net) for DR classification is proposed. The proposed network consists of feature extraction and classification two stages. In the feature extraction stage, a hybrid attention is introduced to suppress the noise, and feature grade decision network is designed to improve feature quality. In the feature classification stage, dual-branch classifiers and corresponding dual-branch loss are designed to alleviate the impact of insufficient data with five-category labels and enhance the classification accuracy. Furthermore, the transfer learning technology is applied in the training process, together with the above steps, to improve the accuracy of model and reduce the amount of training data. Experimental results on KAGGLE dataset indicate that BiRAD-Net shows excellent diagnostic ability for all the stages of DR and preforms better than other existing comparison methods.

Key words: computer application, deep learning, diabetic retinopathy(DR) classification, hybrid attention mechanism, feature grade decision net

CLC Number: 

  • TP391.41

Fig.1

Overview of proposed model structure(BiRAD-Net)"

Fig.2

Structure of hybrid attention mechanism"

Fig.3

Structure of feature grade decision Net-II"

Fig.4

Data preprocessing"

Table 1

Distribution of Kaggle dataset"

标签KAGGLE测试集剩余数据训练集

0

1

2

3

4

25 810

2 443

5 292

873

708

312

312

312

312

312

25 496

2 132

4 980

561

397

对剩余数据加权随机采样,各类样本约1500
总计35 1261 56033 5667500

Table 2

Results of different works based onKaggle dataset"

分类方法

训练集

数据量

实验结果
ACAMacro-F1Micro-F1
Pratt等978 0000.34100.33320.7376
Bravo等11127 4800.50510.50810.5052
Zhao等1233 5660.54310.57250.5436
Luo等1335 1270.54960.5499-
Zhao等14127 4800.59940.6047-
本文方法7 5000.60510.60790.6051

Table 3

Comparison of proposed method with backbone-CNN(Resnet50) in each class"

类别PrecisionRecallF1-Score

本文

方法

ResNet50

本文

方法

ResNet50

本文

方法

ResNet50

0

1

2

3

4

0.6000

0.5340

0.4831

0.6472

0.8305

0.5214

0.4981

0.4603

0.6217

0.8205

0.7019

0.5032

0.5513

0.6410

0.6282

0.7019

0.4199

0.4455

0.6795

0.6154

0.6470

0.5182

0.5150

0.6441

0.7153

0.5984

0.4557

0.4528

0.6493

0.7033

平均0.61700.58440.60510.57240.60790.5718

Fig.5

Confusion matrix"

Fig.6

Receiver operating curve"

Table 4

DR 5 classification results of attentionnetwork ablation experiment"

注意力机制单分支分类器模型双分支分类器模型
R-NetRD-NetBiR-NetBiRD-Net
无注意力0.57240.58390.58840.6032
有注意力0.57440.58850.59100.6051

Table 5

DR 5 classification results of feature gradedecision network ablation experiment"

特征分级

决策网络

单分支分类器模型双分支分类器模型
R-NetRA-NetBiR-NetBiRA-Net
无特征分级0.57240.57440.58840.5910
有特征分级0.58390.58850.60320.6051

Table 6

Accuracy results of 0-1 classifier of models with single classifier or double classifiers"

模型R-NetRA-NetRD-NetRAD-Net
单分支0.83840.8423--
双分支0.83520.84160.84610.8558
1 International Diabetes Federation. IDF diabetes atlas(9th edition)[EB/OL]. [2019-12-01].
2 Altaf F, Islam S M S, Akhtar N, et al. Going deep in medical image analysis: concepts, methods, challenges, and future directions[J]. IEEE Access, 2019, 7: 99540-99572.
3 Shen D G, Wu G R, Suk H. Deep learning in medical image analysis[J]. Annual Review of Biomedical Engineering, 2017, 19(1):221-248.
4 郜峰利, 陶敏, 李雪妍, 等. 基于深度学习的CT影像脑卒中精准分割[J]. 吉林大学学报: 工学版, 2020, 50(2): 678-684.
Gao Feng-li, Tao Min, Li Xue-yan, et al. Accurate segmentation of stroke in CT image based on deep learning[J]. Journal of Jilin University (Engineering and Technology Edition), 2020, 50(2): 678-684.
5 陈雪云, 许韬, 黄小巧. 基于条件生成对抗网络的医学细胞图像生成检测方法[J].吉林大学学报:工学版, 2021, 51(4): 1414-1419.
Chen Xue-yun, Xu Tao, Huang Xiao-qiao. Detection method of medical cell image generation based on conditional generative adversarial network[J]. Journal of Jilin University (Engineering and Technology Edition), 2021, 51(4): 1414-1419.
6 Gargeya R, Leng T. Automated identification of diabetic retinopathy using deep learning[J]. Ophthalmology, 2017, 124(7): 962-969.
7 Gulshan V, Peng L, Coram M, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs[J]. JAMA, 2016, 316(22): 2402-2410.
8 Gondal W M, Kohler J M, Grzeszick R, et al. Weakly-supervised localization of diabetic retinopathy lesions in retinal fundus images[C]∥IEEE International Conference on Image Processing, Beijing, China, 2017: 2069-2073.
9 Pratt H, Coenen F, Broadbent D M, et al. Convolutional neural networks for diabetic retinopathy[J]. Procedia Computer Science, 2016, 90: 200-205.
10 Wang Z, Yin Y, Shi J, et al. Zoom-in-net: deep mining lesions for diabetic retinopathy detection[C]∥International Conference on Medical Image Computing and Computer-Assisted Intervention, Cham, 2017: 267-275.
11 Bravo M A, Arbeláez P A. Automatic diabetic retinopathy classification[C]∥13th International Conference on Medical Information Processing and Analysis, International Society for Optics and Photonics, 2017: No.105721E.
12 Zhao Z Y, Zhang K R, Hao X J, et al. Bira-net: bilinear attention net for diabetic retinopathy grading[C]∥2019 IEEE International Conference on Image Processing, Taipei, China, 2019: 1385-1389.
13 Luo D, Kamata S I. Diabetic retinopathy grading based on lesion correlation graph[J/OL]. [2020-09-28].
14 Zhao Z Y, Chopra K, Zeng Z, et al. Sea-net: squeeze-and-excitation attention net for diabetic retinopathy grading[C]∥2020 IEEE International Conference on Image Processing, Abu Dhabi, United Arab Emirates, 2020: 2496-2500.
15 Zhou Y, He X D, Huang L, et al. Collaborative learning of semi-supervised segmentation and classification for medical images[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition,Long Beach, CA, USA, 2019: 2074-2083.
16 Li X M, Hu X W, Yu L Q, et al. Canet: cross-disease attention network for joint diabetic retinopathy and diabetic macular edema grading[J]. IEEE Transactions on Medical Imaging, 2019, 39(5): 1483-1493.
17 Wang Z G, Yang J B. Diabetic retinopathy detection via deep convolutional networks for discriminative localization and visual explanation[J/OL]. [2020-09-29].
18 Jiang H Y, Yang K, Gao M D, et al. An interpretable ensemble deep learning model for diabetic retinopathy disease classification[C]∥2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Berlin, Germany, 2019: 2045-2048.
19 He K M, Zhang X Y, Ren S Q, et al. Deep residual learning for image recognition[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 2016: 770-778.
20 Woo S, Park J, Lee J Y, et al. Cbam: convolutional block attention module[C]∥Proceedings of the European Conference on Computer Vision, Munich, Germany, 2018: 3-19.
21 Kim Y, Park W, Roh M C, et al. Groupface: Learning latent groups and constructing group-based representations for face recognition[C]∥Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 2020: 5621-5630.
22 Kaggle: diabetic retinopathy detection[EB/OL]. [2019-05-01].
23 Graham B. Kaggle diabetic retinopathy detection competition report[D]. Coventry, UK: University of Warwick, 2015.
[1] Xue WANG,Zhan-shan LI,Ying-da LYU. Medical image segmentation based on multi⁃scale context⁃aware and semantic adaptor [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(3): 640-647.
[2] Su-ming KANG,Ye-e ZHANG. Hadoop⁃based local timing link prediction algorithm across social networks [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(3): 626-632.
[3] Lin SONG,Li-ping WANG,Jun WU,Li-wen GUAN,Zhi-gui LIU. Reliability analysis based on cyber⁃physical system and digital twin [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(2): 439-449.
[4] Jie CAO,Jia-lin MA,Dai-lin HUANG,Ping YU. A fault diagnosis method based on multi Markov transition field [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(2): 491-496.
[5] Gui-xia LIU,Zhi-yao PEI,Jia-zhi SONG. Prediction of protein-ATP binding site based on deep learning [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(1): 187-194.
[6] You QU,Wen-hui LI. Single-stage rotated object detection network based on anchor transformation [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(1): 162-173.
[7] Hong-wei ZHAO,Dong-sheng HUO,Jie WANG,Xiao-ning LI. Image classification of insect pests based on saliency detection [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(6): 2174-2181.
[8] Jie ZHANG,Wen JING,Fu CHEN. Vulnerability detection of instant messaging network protocol based on passive clustering algorithm [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(6): 2253-2258.
[9] Zhou-zhou LIU,Qian-yun ZHANG,Xin-hua MA,Han PENG. Compressed sensing signal reconstruction based on optimized discrete differential evolution algorithm [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(6): 2246-2252.
[10] Sheng-sheng WANG,Jing-yu CHEN,Yi-nan LU. COVID⁃19 chest CT image segmentation based on federated learning and blockchain [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(6): 2164-2173.
[11] Dong-ming SUN,Liang HU,Yong-heng XING,Feng WANG. Text fusion based internet of things service recommendation for trigger⁃action programming pattern [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(6): 2182-2189.
[12] Jun-cong LIN,Jun LEI,Meng CHEN,Shi-hui GUO,Xing GAO,Ming-hong LIAO. Real⁃time camera planning for dynamic multiple targets considering cinematographic visual properties [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(6): 2154-2163.
[13] Li-li REN,Zhi-jun WANG,Dong-mei YAN. Improved multi⁃verse algorithm with combined slime mould foraging behavior [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(6): 2190-2197.
[14] Yin-di YAO,Jun-jin HE,Yang-li LI,Dang-yuan XIE,Ying LI. ET0 simulation of self⁃constructed improved whale optimized BP neural network [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(5): 1798-1807.
[15] Li-li DONG,Dan YANG,Xiang ZHANG. Large⁃scale semantic text overlapping region retrieval based on deep learning [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(5): 1817-1822.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!