增强Bagging集成学习及多目标检测算法

doi:10.13229/j.cnki.jdxbgxb20220503

Abstract

Abstract:

Aiming at the problems of low localization accuracy and classification accuracy in medical imaging disease detection by existing target detection algorithms， a multi-target detection method based on dynamic weighted Bagging ensemble learning was proposed. Taking chest imaging disease detection as an example， the Coordinate Attention （CA） module was introduced to enhance the receptive field of the region and improve the weak learner's ability to locate the target region. The dynamic weighted Bagging ensemble learning method was used to give the weak learner voting weight according to the confidence. The variance of the model was reduced， the generalization error was improved， and the classification accuracy was improved. The experimental results show that in the chest imaging disease detection task， the average detection accuracy of the proposed algorithm reaches 41.9%， which is 2.5% higher than that of the YOLOv5 prototype， and G-mean is improved by 1.3%； after the model is weighted and integrated， the average detection accuracy rate reaches 81.06%， which is 1.58% higher than the original model， and has high positioning accuracy and classification accuracy. Therefore， the proposed algorithm can better complete the task of chest imaging disease detection.

Key words: computer application, chest imaging disease detection, dynamically weighted Bagging ensemble learning, coordinate attention

CLC Number:

TP391.4

Xiang-jiu CHE,Ying-jie YU,Quan-le LIU. Enhanced Bagging ensemble learning and multi⁃target detection algorithm[J].Journal of Jilin University(Engineering and Technology Edition), 2022, 52(12): 2916-2923.

Figures/Tables 17

Fig.1

Fig.2

Fig.3

Table 1

Fig.4

Fig.5

Fig.6

Fig.7

Fig.8

Table 2

Table 3

Table 4

Table 5

Table 6

Table 7

Fig.9

Fig.10

References 25

1	de Carvalho Filho A O, de Sampaio W B, Silva A C, et al. Automatic detection of solitary lung nodules using quality threshold clustering, genetic algorithm and diversity index[J]. Artificial Intelligence in Medicine, 2014, 60(3): 165-177.
2	Choi W J, Choi T S. Automated pulmonary nodule detection based on three-dimensional shape-based feature descriptor[J]. Computer Methods and Programs in Biomedicine, 2014, 113(1): 37-54.
3	Zhang Z, Zhang X, Lin X, et al. Ultrasonic diagnosis of breast nodules using modified faster R-CNN[J]. Ultrasonic Imaging, 2019, 41(6): 353-367.
4	Ramachandran S, George J, Skaria S, et al. Using YOLO based deep learning network for real time detection and localization of lung nodules from low dose CT scans[C]∥Medical Imaging 2018: Computer-Aided Diagnosis, Houston, Texas, USA, 2018, 10575: 347-355.
5	Johnson J M, Khoshgoftaar T M. Survey on deep learning with class imbalance[J]. Journal of Big Data, 2019, 6(1):1-54.
6	申彦, 朱玉全, 宋新平. 一种采用渐进学习模式的SBS-CLearning分类算法[J]. 江苏大学学报:自然科学版, 2018, 39(6): 696-703.
	Shen Yan, Zhu Yu-quan, Song Xin-ping. A classification learning algorithm of SBS-CLearning using step-by-step learning model[J]. Journal of Jiangsu University(Natural Science Edition), 2018, 39(6): 696-703.
7	Kazemi Y, Mirroshandel S A. A novel method for predicting kidney stone type using ensemble learning[J]. Artificial intelligence in Medicine, 2018, 84:117-126.
8	Farahani F V, Ahmadi A, Zarandi M H F. Lung nodule diagnosis from CT images based on ensemble learning[C]∥2015 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB), Niagara Falls, ON, Canada, 2015:1-7.
9	Fitriyani N L, Syafrudin M, Alfian G, et al. Development of disease prediction model based on ensemble learning approach for diabetes and hypertension[J]. IEEE Access, 2019, 7:144777-144789.
10	Wang Yu-yan, Wang Du-juan, Geng Na, et al. Stacking-based ensemble learning of decision trees for interpretable prostate cancer detection[J]. Applied Soft Computing, 2019, 77: 188-204.
11	Zheng Hao, Zhang Yi-zhe, Yang Lin, et al. A new ensemble learning framework for 3D biomedical image segmentation[J]. AAAI Technical Track: Machine Learning, 2019, 33(1): 5909-5916.
12	Gao X Y, Amin A A, Shaban H H, et al. Improving the accuracy for analyzing heart diseases prediction based on the ensemble method[J]. Complexity, 2021, 2021:1-10.
13	Girshick R, Donahue J, Darrell T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA, 2014:580-587.
14	Girshick R. Fast R-CNN[C]∥Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile, 2015:1440-1448.
15	Ren S Q, He K M, Girshick R, et al. Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6): 1137-1149.
16	牛杰, 钱堃, 卜雄洙. 基于YOLOv3算法和深度特征的地点识别方法[J]. 江苏大学学报:自然科学版, 2021, 42(6): 733-737.
	Niu Jie, Qian Kun, Bu Xiong-zhu. Place recognition method based on YOLOv3 and deep features[J]. Journal of Jiangsu University(Natural Science Edition), 2021, 42(6): 733-737.
17	Redmon J, Divvala S, Girshick R, et al. You only look once: Unified, real-time object detection[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 2016:779-788.
18	Nguyen H Q, Lam K, Le L T, et al. VinDr-CXR: an open dataset of chest X-rays with radiologist's annotations[J/OL].[2022-04-15]. file:∥/C:/Users/ADMINI~1/AppData/Local/Temp/MicrosoftEdgeDownloads/4fb2e789-21c9-43c9-b06b-d06266b169fb/s41597-022-01498 -w.pdf
19	王进, 黄超, 王科, 等. 基于属性敏感卷积神经网络的行人属性分类[J]. 江苏大学学报:自然科学版, 2019, 40(4): 431-438.
	Wang Jin, Huang Chao, Wang Ke, et al. Pedestrian attribute classification based on label sensitive convolutional neural network[J]. Journal of Jiangsu University(Natural Science Edition), 2019, 40(4): 431-438.
20	Hu J, Shen L, Sun G. Squeeze-and-excitation networks[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 2018:7132-7141.
21	Woo S, Park J, Lee J Y, et al. CBAM: convolutional block attention module[J] Lecture Notes in Computer Science, 2018,11211: 3-19.
22	Hou Qin-bin, Zhou Da-quan, Feng Jia-shi. Coordinate attention for efficient mobile network design[C]∥2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, 2021:13713-13722.
23	袁梅, 全太锋, 黄俊, 等. 基于卷积神经网络的烟雾检测[J]. 重庆邮电大学学报: 自然科学版, 2020, 32(4): 620-629.
	Yuan Mei, Quan Tai-feng, Huang Jun, et al. Smoke detection based on convolutional neural network[J]. Journal of Chongqing University of Posts and Telecommunications (Natural Science Edition), 2020, 32(4): 620-629.
24	Kubat M, Matwin S. Addressing the curse of imbalanced training sets: one-sided selection[C]∥Proceedings of the Fourteenth International Conference on Machine Learning, Nashville, Tennessee, USA, 1997:179-186.
25	Breiman L. Bagging predictors[J]. Machine Learning, 1996, 24(2): 123-140.

Related Articles 15

[1]	Xian-yu QI,Wei WANG,Lin WANG,Yu-fei ZHAO,Yan-peng DONG. Semantic topological map building with object semantic grid map [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(2): 569-575.
[2]	Xiao-hu SHI,Jia-qi WU,Chun-guo WU,Shi CHENG,Xiao-hui WENG,Zhi-yong CHANG. Residual network based curve enhanced lane detection method [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(2): 584-592.
[3]	Peng GUO,Wen-chao ZHAO,Kun LEI. Dual⁃resource constrained flexible job shop optimal scheduling based on an improved Jaya algorithm [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(2): 480-487.
[4]	Jin-Zhen Liu,Guo-Hui Gao,Hui Xiong. Multi⁃scale attention network for brain tissue segmentation [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(2): 576-583.
[5]	Gui-he QIN,Jun-feng HUANG,Ming-hui SUN. Text input based on two⁃handed keyboard in virtual environment [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(8): 1881-1888.
[6]	Fu-heng QU,Tian-yu DING,Yang LU,Yong YANG,Ya-ting HU. Fast image codeword search algorithm based on neighborhood similarity [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(8): 1865-1871.
[7]	Tian BAI,Ming-wei XU,Si-ming LIU,Ji-an ZHANG,Zhe WANG. Dispute focus identification of pleading text based on deep neural network [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(8): 1872-1880.
[8]	Feng-feng ZHOU,Hai-yang ZHU. SEE： sense EEG⁃based emotion algorithm via three⁃step feature selection strategy [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(8): 1834-1841.
[9]	Feng-feng ZHOU,Yi-chi ZHANG. Unsupervised feature engineering algorithm BioSAE based on sparse autoencoder [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(7): 1645-1656.
[10]	Jun WANG,Yan-hui XU,Li LI. Data fusion privacy protection method with low energy consumption and integrity verification [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(7): 1657-1665.
[11]	Yao-long KANG,Li-lu FENG,Jing-an ZHANG,Fu CHEN. Outlier mining algorithm for high dimensional categorical data streams based on spectral clustering [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(6): 1422-1427.
[12]	Wen-jun WANG,Yin-feng YU. Automatic completion algorithm for missing links in nowledge graph considering data sparsity [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(6): 1428-1433.
[13]	Xue-yun CHEN,Xue-yu BEI,Qu YAO,Xin JIN. Pedestrian segmentation and detection in multi-scene based on G-UNet [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(4): 925-933.
[14]	Shi-min FANG. Multiple source data selective integration algorithm based on frequent pattern tree [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(4): 885-890.
[15]	Da-xiang LI,Meng-si CHEN,Ying LIU. Spontaneous micro-expression recognition based on STA-LSTM [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(4): 897-909.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

Comments

Recommended 10

[1]	LI Xiao-lei1,LI Dan,YIN Yong-guang. Enzymatic preparation of linear malto oligosaccharides[J]. 吉林大学学报(工学版), 2009, 39(06): 1559 -1562 .
[2]	SONG Chuan-Xue, GAO Jin, YANG Shu-Kai. Virtual simulation analysis about influence of suspension on full vehicle ride comfort[J]. 吉林大学学报(工学版), 2010, 40(增刊): 6 -00012 .
[3]	GUO Song, GU Guo-Chang, CA Ze-Su, LIU Hai-Bo, SHEN Jing. Face detection based on skin color segmentation and improved AdaBoostSVM algorithm[J]. 吉林大学学报(工学版), 2011, 41(02): 473 -0478 .
[4]	Song Yu-lai, Liu Yao-hui, Zhu Xian-yong, Wang Su-huan, Yu Si-rong. Effect of neodymium on microstructure and mechanical properties of AZ91 magnesium alloy[J]. 吉林大学学报(工学版), 2006, 36(03): 289 -0293 .
[5]	Lu Ying-rong，Yang Yin-sheng，Lv Feng . Optimal vehicle routing problem based on fuzzy clustering analysis[J]. 吉林大学学报(工学版), 2006, 36(增刊2): 147 -151 .
[6]	ZHANG Ying-feng, MA Biao, ZHU Yuan, ZHANG Jin-le. State identification of power-shift steering transmission based on hypersphere support vector machine[J]. 吉林大学学报(工学版), 2012, 42(01): 13 -18 .
[7]	MA Xun,WANG He,NA Jing-xin. Rib equivalence model of CAE analysis in car body concept design phase[J]. 吉林大学学报(工学版), 2009, 39(06): 1431 -1434 .
[8]	YANG Ji-kuang,YE Ying-tai,PENG Qian,WU Shen-rong,GUO Jie. Application of spot weld model using solid element in simulation of front longitudinal beam crash[J]. 吉林大学学报(工学版), 2011, 41(6): 1542 -1548 .
[9]	SHEN Yan-hu, SU Jiang, LIU Yong, YANG Zhi-gang, WANG Kun-kun. Design of piezoelectric vibratory feeder vertically driven by two piezoelectric vibrators[J]. 吉林大学学报(工学版), 2014, 44(6): 1669 -1675 .
[10]	ZHANG Lei, ZHAO Yun-wei, YANG Zhuo, ZHAO Ji. Shear yield property of electrorheological polishing fluid[J]. , 2012, 42(05): 1145 -1150 .

病理学标签	疾病描述	数量
主动脉扩张	发生在主动脉血管壁的异常隆起	3067
心脏扩大	成年病人的心胸比率大于0.5	2300
实质化	肺泡内充满液体、脓液、血液、细胞（包括肿瘤细胞）或其他物质，导致大叶性、弥漫性或多灶性不清混浊的病理过程。	386
胸膜增厚	涉及壁层或脏层胸膜的任何形式的增厚	1981
胸腔积液	胸腔内异常积液	1032
肺纤维化	肺里有多余的纤维组织	1617

模型	测试例1	测试例2	测试例3
1	√	ⅹ	ⅹ
2	ⅹ	√	ⅹ
3	ⅹ	ⅹ	√
集成	ⅹ	ⅹ	ⅹ

真实情况	预测结果
真实情况	正例	反例
正例	TP	FN
反例	FP	TN

方法	主动脉扩张	心脏扩大	实质化	胸膜增厚	胸腔积液	肺纤维化	均值
Faster-RCNN	0.521	0.830	0.537	0.434	0.443	0.354	0.520
YOLOv4	0.632	0.732	0.604	0.511	0.482	0.395	0.559
YOLOv5	0.651	0.800	0.635	0.532	0.500	0.452	0.595
CA-YOLOv5	0.662	0.828	0.641	0.538	0.524	0.464	0.610

方法	主动脉扩张	心脏扩大	实质化	胸膜增厚	胸腔积液	肺纤维化	均值
Faster-RCNN	0.500	0.545	0.202	0.185	0.283	0.160	0.313
YOLOv4	0.657	0.525	0.249	0.209	0.349	0.190	0.363
YOLOv5	0.672	0.539	0.263	0.222	0.402	0.265	0.394
CA-YOLOv5	0.699	0.550	0.323	0.235	0.428	0.278	0.419

Enhanced Bagging ensemble learning and multi⁃target detection algorithm

RICH HTML

PDF (PC)