Journal of Jilin University(Engineering and Technology Edition) ›› 2022, Vol. 52 ›› Issue (4): 916-924.doi: 10.13229/j.cnki.jdxbgxb20200896

Previous Articles    

Panoramic mosaic approach of ultrasound medical images based on template fusion

Hai-yang JIA1,2(),Rui XIA1,An-qi LYU1,Ceng-xuan GUAN1,Juan CHEN1,2(),Lei WANG3   

  1. 1.College of Computer Science and technology，Jilin University，Changchun 130012，China
    2.Key Laboratory for Symbolic Computation and Knowledge Engineering of Ministry of Education，Jilin University，Changchun 130012，China
    3.The First Hospital of Jilin University，Changchun 130012，China
  • Received:2020-11-23 Online:2022-04-01 Published:2022-04-20
  • Contact: Juan CHEN E-mail:jiahy@jlu.edu.cn;chenjuan@jlu.edu.cn

RICH HTML

 8   

PDF (PC)

224

Abstract:

The panoramic mosaic technology can get a larger field of observation view， based on the partial medical images obtained by ultrasonic detection device. Through stitching and fusing， it can provide more intuitive and comprehensive information for clinical diagnosis and doctor-patient communication. However， due to the influence of objective factors such as low precision image and more noise caused by medical equipment， the results of traditional panoramic mosaic method are not ideal. To solve the problems above， a template fusion method based on improved k-MEANS clustering algorithm for ultrasonic medical image mosaic is proposed. Compared with the traditional template stitching algorithm， this method can self-organize the region with dense features into flexible template， and improve the speed of adjacent image matching by using heuristic window algorithm. The experimental results show that the template detection rate and average template density are improved， the image registration accuracy is improved， and the method has high robustness and real-time performance.

Key words: ultrasound image, fusion splicing, image processing, template matching

CLC Number: 

  • TP391.4

Fig.1

Flow chart of ultrasound image mosaic"

Fig.2

Schematic diagram of Sobel operator"

Fig.3

Extraction effect of image feature points"

Fig.4

Structure presentation of KD tree based on image"

Fig.5

Data structure presentation of KD tree"

Fig.6

Comparison of two adjacent frames obtained by k-MEANS clustering"

Fig.7

Fusion effect of image growth technology"

Fig.8

Fusion effect of mean"

Fig.9

Weighted fusion effect"

Fig.10

Experiment results of set 1"

Fig.11

Experiment results of set 2"

Fig.12

Mosaic image of a complete blood vessel obtained by proposed method"

1 李义兵, 余大昆, 林家瑞, 等. 实时全景超声成像技术[J]. 医疗设备信息, 2005, 20(10): 39-40, 76.
Li Yi-bing, Yu Da-kun, Lin Jia-rui, et al. Panoramic ultrasound imaging[J]. Information of Medical Equipment, 2005, 20(10): 39-40, 76.
2 孙莹. 图像特征点提取与描述算法研究[J]. 信息安全与技术, 2016, 7(2): 18-21.
Sun Ying. Research on algorithm of image feature extraction and description[J]. Information Security and Technology, 2016, 7(2): 18-21.
3 孟祥菲. 基于二维超声图像的右心室运动轨迹跟踪[D]. 沈阳:东北大学中荷生物医学与信息工程学院, 2014.
Meng Xiang-fei. On the trajectory tracking of right ventricles using two-dimensional ulstrasound images[D]. Shenyang: Sino-Dutch Biomedical and Information Engineering School, Northeastern University, 2014.
4 颜焕欢, 张培镇, 王伊侬, 等. 肌骨超声图像特征检测及拼接[J]. 中国图象图形学报, 2020, 25(5): 1032-1042.
Yan Huan-huan, Zhang Pei-zhen, Wang Yi-nong, et al. Feature detection algorithm of musculoskeletal ultrasound image and its application of image stitching[J]. Journal of Image and Graphics, 2020, 25(5): 1032-1042.
5 裴红星, 刘金达, 葛佳隆, 等. 图像拼接技术综述[J]. 郑州大学学报: 理学版, 2019, 51(4): 1-10, 29.
Pei Hong-xing, Liu Jin-da, Ge Jia-long, et al. A review on image mosaicing techniques[J]. Journal of Zhengzhou University(Natural Science Edition), 2019, 51(4): 1-10, 29.
6 Lee Weng, Tirumalai Arun P. Method and apparatus for generating large compound ultrasound image[P]. United States Patent.
7 Lee Weng, Tirumalai Arun P. Method and apparatus for generating large compound ultrasound image[J]. Journal of the Acoustical Society of America, 1997, 101(6): 3239
8 杜亚军, 高上凯. 基于PC平台的扩展视野超声成像[J]. 中国医学影像技术, 2005, 21(8): 1281-1284.
Du Ya-jun, Gao Shang-kai. PC-based extended field-of-view ultrasound imaging[J]. Chinese Journal of Medical Imaging Technology, 2005, 21(8): 1281-1284.
9 邵斌, 唐娉, 曾庆业, 等. 基于PC的实时超声全景成像系统中的图像配准[J]. 计算机工程与应用, 2007, 43(28): 206-209.
Shao Bin, Tang Ping, Zeng Qing-ye, et al. Image registration in a PC-based real-time ultrasound panoramic imaging system[J]. Computer Engineering and Applications, 2007, 43(28): 206-209.
10 郑烁鹤. 基于PC的实时医学超声宽景成像技术研究[D]. 广州:华南理工大学电子与信息学院, 2011.
Zheng Shuo-he. Study on PC-based real-time extended-field-of-view ultrasound[D]. Guangzhou: School of Electronic and Information Engineering, South China University of Technology, 2011.
11 李锦, 王俊平, 万国挺, 等. 一种结合直方图均衡化和MSRCR的图像增强新算法[J]. 西安电子科技大学学报, 2014, 41(3): 103-109.
Li Jin, Wang Jun-ping, Wan Guo-ting, et al. Novel algorithm for image enhancement with histogram equlization and MSRCR[J]. Journal of Xidian University, 2014, 41(3): 103-109.
12 Ingber L. Simulated annealing: practice versus theory[J]. Mathematical and Computer Modelling, 1993, 18(11): 29-57.
13 王小平, 王建勇, 杨埙. 基于Sobel算子和改进SURF算法的图像拼接方法[J]. 电视技术, 2014, 38(13): 43-46.
Wang Xiao-ping, Wang Jian-yong, Yang Xun. Image stitching method based on Sobel operator and improved SURF algorithm[J]. Video Engineering, 2014, 38(13): 43-46.
14 马艳, 张治辉. 几种边缘检测算子的比较[J]. 工矿自动化, 2004, 31(1): 54-56.
Ma Yan, Zhang Zhi-hui. Comparison of several edge detection operators[J]. Industry and Mine Automation, 2004, 31(1): 54-56.
15 朱远平, 夏利民. 一种适用于图像拼接的自适应模板匹配算法[J]. 计算机工程与应用, 2003, 39(31): 109-111, 139.
Zhu Yuan-ping, Xia Li-min. A robust template matching algorithm for automatic image stitching[J]. Computer Engineering and Applications, 2003, 39(31): 109-111, 139.
16 吴夙慧, 成颖, 郑彦宁, 等. K-means算法研究综述[J]. 现代图书情报技术, 2011, 31(5): 28-35.
Wu Su-hui, Cheng Ying, Zheng Yan-ning, et al. Survey on K-means algorithm[J]. New Technology of Library and Information Service, 2011, 31(5): 28-35.
17 高亮, 谢健, 曹天泽. 基于Kd树改进的高效K-means聚类算法[J]. 计算技术与自动化, 2015, 34(4): 69-74.
Gao Liang, Xie Jian, Cao Tian-ze. An improved K-means clustering algorithm with high efficiency based on the Kd tree[J]. Computing Technology and Automation, 2015, 34(4): 69-74.
18 陈为龙, 郭黎. 一种基于膨胀的渐进渐出图像融合算法[J]. 计算机工程与科学, 2014, 36(7): 1347-1351.
Chen Wei-long, Guo Li. A novel fade-in-and-fade-out image fusion algorithm based on dilation[J]. Computer Engineering and Science, 2014, 36(7): 1347-1351.
[1] Kang WANG,Meng YAO,Li-ben LI,Jian-qiao LI,Xiang-jin DENG,Meng ZOU,Long XUE. Mechanical performance identification for lunar soil in lunar surface sampling [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(3): 1146-1152.
[2] Jian LI,Kong-yu LIU,Xian-sheng REN,Qi XIONG,Xue-feng DOU. Application of canny algorithm based on adaptive threshold in MR Image edge detection [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(2): 712-719.
[3] Fu LIU,Lu LIU,Tao HOU,Yun LIU. Night road image enhancement method based on optimized MSR [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(1): 323-330.
[4] LIU Zhe, XU Tao, SONG Yu-qing, XU Chun-yan. Image fusion technology based on NSCT and robust principal component analysis model with similar information [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(5): 1614-1620.
[5] CHE Xiang-jiu, WANG Li, GUO Xiao-xin. Improved boundary detection based on multi-scale cues fusion [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(5): 1621-1628.
[6] LIANG Shi-li, CHAI Zong-qian, ZHANG Ling, WU Yan-sheng, CAO Chun-lei. Image encryption method based on partial X type cellular automaton [J]. 吉林大学学报(工学版), 2017, 47(5): 1653-1660.
[7] HE Guang, ZHANG Ming, YUAN Shuang-shi. Temperature-related dynamic characteristics of MEMS setback arming device [J]. 吉林大学学报(工学版), 2017, 47(1): 145-150.
[8] LI Jian, LI He-yu, YAO Ru-jing, WU Lin. Check of MR image edge information of lumber intervertebral disc using an improved Canny algorithm [J]. 吉林大学学报(工学版), 2016, 46(5): 1704-1709.
[9] XIAO Zhong-jie. Recognition of digital image based on wavelet space feature spectrum entropy [J]. 吉林大学学报(工学版), 2015, 45(6): 1994-1998.
[10] HAN Cheng, ZHANG Chao, QIN Gui-he, XUE Yao-hong, YANG Fan, FAN Jing-tao, LIU Wen-jing. An algorithm of optical radiometric compensation for projective system of large-scale orthogonal multi-screens [J]. 吉林大学学报(工学版), 2015, 45(4): 1266-1273.
[11] CHEN Yong-heng,WEI Ming-li,QU Zhao-wei,ZHANG Hu,CAO Ning-bo. Pedestrian crossing characteristics under influence of left-turn vehicle [J]. 吉林大学学报(工学版), 2015, 45(1): 62-67.
[12] ZHANG Jin-guo,GUO Hai-tao,WU Jun-peng,LI Yi-tong. Improved minimum symmetric Tsallis cross entropy for segmentation of a sonar image from a small underwater target [J]. 吉林大学学报(工学版), 2014, 44(3): 834-839.
[13] HUANG De-tian, LIU Xue-chao, WU Zhi-yong, LIANG Min-hua. Design of high-speed image acquisition and processing system based on cameraLink [J]. 吉林大学学报(工学版), 2013, 43(增刊1): 309-312.
[14] FENG Xin, WANG Xiao-ming, DANG Jian-wu, SHEN Yu. Image fusion method based on interpolation Directionlet [J]. 吉林大学学报(工学版), 2013, 43(04): 1127-1132.
[15] XIE Zhi-jiang, LYU Bo, LIU Qin, CHEN Ping. Rotation-invariant and fast image template matching algorithm [J]. 吉林大学学报(工学版), 2013, 43(03): 711-717.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright © Journal of Jilin University(Engineering and Technology Edition), All Rights Reserved.
Tel: +86-431-85095297　Fax: +86-431-85094074　E-mail: xbgxb@jlu.edu.cn
Powered by Beijing Magtech Co. Ltd