Journal of Jilin University(Engineering and Technology Edition) ›› 2018, Vol. 48 ›› Issue (5): 1614-1620.doi: 10.13229/j.cnki.jdxbgxb20170928

Previous Articles     Next Articles

Image fusion technology based on NSCT and robust principal component analysis model with similar information

LIU Zhe1, XU Tao2, SONG Yu-qing1, XU Chun-yan1   

  1. 1.School of Computer Science and Communication Engineering,Jiangsu University,Zhenjiang 212013,China;
    2.College of Mechanical Science and Engineering, Jilin University,Changchun 130022,China
  • Received:2017-09-20 Online:2018-09-20 Published:2018-12-11

Abstract: In traditional medical image fusion process based on single pixel, the information similarity is ignored and detailed information may loss. To solve these problems, an image fusion technology based on Nonsubsampled Contourlet (NSCT) and Robust Principal Component Analysis (RPCA) model with similar information is proposed. First, the initial matrix constructed by the image block from the original images is decomposed into low frequency and high frequency parts by NSCT transformation. Second, the low rank component is decomposed into low rank matrix and spare error matrix by using the low rank matrix model with similar information. Third, the low rank matrix of the two images, the spare error matrix and high-frequency components are fused by fusion rule of the absolute maximum method. Finally the fusion image is replaced by the inverse transform. The experiment results on CT and MRI show that the proposed method can maintain more edge and texture detailed information of the source images.

Key words: image processing, image fusion, Nonsubsampled contourlet transform(NSCT), robust principal component analysis, low-rank matrix

CLC Number: 

  • TP391.4
[1] Du J, Li W, Lu K, et al.An overview of multi-modal medical image fusion[J]. Neurocomputing, 2016, 215:3-20.
[2] Yin H.Sparse representation with learned multiscale dictionary for image fusion[J]. Neurocomputing, 2015, 148:600-610.
[3] Yin H, Li Y, Chai Y, et al.A novel sparse-representation-based multi-focus image fusion approach[J]. Neurocomputing, 2016, 216:216-229.
[4] Liu Y, Liu S, Wang Z.A general framework for image fusion based on multi-scale transform and sparse representation[J]. Information Fusion, 2015, 24:147-164.
[5] Ren K, Xu F.Super-resolution images fusion via compressed sensing and low-rank matrix decomposition[J]. Infrared Physics and Technology, 2015, 68:61-68.
[6] Wang Q, Li S, Qin H, et al.Robust multi-modal medical image fusion via anisotropic heat diffusion guided low-rank structural analysis[J]. Information Fusion, 2015, 26(C):103-121.
[7] Candès E J,Li X,Ma Y,et al.Robust principal component analysis[J].Journal of the ACM,2011,58(3):11.
[8] Ni Y, Sun J, Yuan X, et al.Robust low-rank subspace segmentation with semidefinite guarantees[C]∥IEEE International Conference on Data Mining Workshops,IEEE,Computer Society,2010:1179-1188.
[9] Liu G, Lin Z, Yan S, et al.Robust recovery of subspace structures by low-rank representation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013,35(1):171-184.
[10] Candès,Emmanuel J.The restricted isometry property and its implications for compressed sensing[J].Comptes Rendus Mathematique,2008,346(9/10):589-592.
[11] 史加荣, 郑秀云, 魏宗田,等. 低秩矩阵恢复算法综述[J]. 计算机应用研究, 2013, 30(6):1601-1605.
Shi Jia-rong,Zheng Xiu-yun, Wei Zong-tian,et al.Survey on algorighms of low-rank matrix recovery[J].Application Research of Computers,2013, 30(6):1601-1605.
[12] 刘园园. 快速低秩矩阵与张量恢复的算法研究[D]. 西安:西安电子科技大学智能感知与图像理解教育部重点实验室, 2013.
Liu Yuan-yuan.Algorithm research of fast low-rand matrix and tenser recovery[D].Xi'an: Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, Xidian University,2013.
[13] Chandrasekaran V, Sanghavi S, Parrilo P A, et al.Rank-sparsity incoherence for matrix decomposition[J]. SIAM Journal on Optimization, 2011, 21(2):572-596.
[14] Cai J F,Cand S E J,et al.A singular value thresholding algorithm for matrix completion[J]. SIAM Journal on Optimization,2010,20(4):1956-1982.
[15] Cunha A L D, Zhou J, Do M N.The nonsubsampled contourlet transform:Theory Desigh,and Applications[J].IEEE Transactions on Image Processing,2006,15(10):3089-3100.
[16] 崔玲玲, 卢朝阳, 李静,等. 基于非下采样Contourlet域高斯混合模型的布匹瑕疵识别算法[J]. 吉林大学学报:工学版, 2013, 43(3):734-739.
Cui Ling-ling, Lu Zhao-yang,Li Jing, et al.Fabric defect recognition algorithm based on Gaussian mixture model in nonsubsampled contourlet domain[J].Journal of Jilin University(Engineering and Technology Edition),2013, 43(3):734-739.
[17] http://www.med.harvard.edu/AANLIB/.[2017-07-08].
[18] Kumar B K S. Image fusion based on pixel significance using cross bilateral filte[J]. Signal, Image and Video Processing, 2015, 9(5):1193-1204.
[19] Xydeas C S, Petrovic V.Objective image fusion performance measure[J]. Military Technical Courier, 2000, 36(4):308-309.
[20] 郭雷,李晖晖,鲍永生. 图像融合[M]. 北京:电子工业出版社,2008.
[21] Prakash O, Srivastava R, Khare A.Biorthogonal wavelet transform based image fusion using absolute maximum fusion rule[C]∥Information and Communication Technologies,IEEE,2013:577-582.
[22] Jiao Z, Shao J, Xu B.A Novel Multi-focus Image Fusion Method Using NSCT and PCNN[M].Berlin Heidelberg:Springer,2012:161-170.
[23] Niu Y, Shen L.The optimal multi-objective optimization using PSO in blind color image fusion[C]∥International Conference on Multimedia & Ubiquitous Engineering,IEEE Computer Society, 2007:970-975.
[24] 刘羽, 汪增福. 结合小波变换和自适应分块的多聚焦图像快速融合[J].中国图象图形学报, 2013, 18(11):1435-1444.
Liu Yu, Wang Zeng-fu.Multi-focus image fusion based on wavelet transform and adaptive block[J].Journal of Image and Graphics.2013, 18(11):1435-1444.
[25] Li S, Kang X, Hu J.Image fusion with guided filtering[J].IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society, 2013, 22(7):2864-2875.
[1] CHE Xiang-jiu, WANG Li, GUO Xiao-xin. Improved boundary detection based on multi-scale cues fusion [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(5): 1621-1628.
[2] LIANG Shi-li, CHAI Zong-qian, ZHANG Ling, WU Yan-sheng, CAO Chun-lei. Image encryption method based on partial X type cellular automaton [J]. 吉林大学学报(工学版), 2017, 47(5): 1653-1660.
[3] HE Guang, ZHANG Ming, YUAN Shuang-shi. Temperature-related dynamic characteristics of MEMS setback arming device [J]. 吉林大学学报(工学版), 2017, 47(1): 145-150.
[4] YIN Ming, ZHAN Yin-wei, PEI Hai-long. Co-sparse analysis operator learning for image fusion [J]. 吉林大学学报(工学版), 2016, 46(6): 2052-2058.
[5] LI Jian, LI He-yu, YAO Ru-jing, WU Lin. Check of MR image edge information of lumber intervertebral disc using an improved Canny algorithm [J]. 吉林大学学报(工学版), 2016, 46(5): 1704-1709.
[6] XIAO Zhong-jie. Recognition of digital image based on wavelet space feature spectrum entropy [J]. 吉林大学学报(工学版), 2015, 45(6): 1994-1998.
[7] HAN Cheng, ZHANG Chao, QIN Gui-he, XUE Yao-hong, YANG Fan, FAN Jing-tao, LIU Wen-jing. An algorithm of optical radiometric compensation for projective system of large-scale orthogonal multi-screens [J]. 吉林大学学报(工学版), 2015, 45(4): 1266-1273.
[8] CHEN Yong-heng,WEI Ming-li,QU Zhao-wei,ZHANG Hu,CAO Ning-bo. Pedestrian crossing characteristics under influence of left-turn vehicle [J]. 吉林大学学报(工学版), 2015, 45(1): 62-67.
[9] WANG Xiao-wen, ZHAO Zong-gui, PANG Xiu-mei, LIU Min. Image fusion method based on visual saliency maps [J]. 吉林大学学报(工学版), 2014, 44(4): 1203-1208.
[10] ZHANG Jin-guo,GUO Hai-tao,WU Jun-peng,LI Yi-tong. Improved minimum symmetric Tsallis cross entropy for segmentation of a sonar image from a small underwater target [J]. 吉林大学学报(工学版), 2014, 44(3): 834-839.
[11] YANG Yang, DAI Ming, ZHOU Luo-yu, SUN Ming-chao. Multifocus image fusion based on nonsubsampled Bandelet transform [J]. 吉林大学学报(工学版), 2014, 44(2): 525-530.
[12] WANG Xin, LI Wei-lin, LIU Fu. New algorithm of CT/MRI medical image fusion based on wavelet domain [J]. 吉林大学学报(工学版), 2013, 43(增刊1): 25-28.
[13] BAO Lei, XU Qi-zhi. Spectrum-keeping algorithm for fusing based on PCA [J]. 吉林大学学报(工学版), 2013, 43(增刊1): 88-91.
[14] HUANG De-tian, LIU Xue-chao, WU Zhi-yong, LIANG Min-hua. Design of high-speed image acquisition and processing system based on cameraLink [J]. 吉林大学学报(工学版), 2013, 43(增刊1): 309-312.
[15] LI Juan, NAN Xu-liang, BI Si-yuan, WU Wei. Image Fusion based on an improved algorithm of Multi-objective Particle swarm Optimization [J]. 吉林大学学报(工学版), 2013, 43(增刊1): 477-480.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] LIU Song-shan, WANG Qing-nian, WANG Wei-hua, LIN Xin. Influence of inertial mass on damping and amplitude-frequency characteristic of regenerative suspension[J]. 吉林大学学报(工学版), 2013, 43(03): 557 -563 .
[2] CHU Liang, WANG Yan-bo, QI Fu-wei, ZHANG Yong-sheng. Control method of inlet valves for brake pressure fine regulation[J]. 吉林大学学报(工学版), 2013, 43(03): 564 -570 .
[3] LI Jing, WANG Zi-han, YU Chun-xian, HAN Zuo-yue, SUN Bo-hua. Design of control system to follow vehicle state with HIL test beach[J]. 吉林大学学报(工学版), 2013, 43(03): 577 -583 .
[4] HU Xing-jun, LI Teng-fei, WANG Jing-yu, YANG Bo, GUO Peng, LIAO Lei. Numerical simulation of the influence of rear-end panels on the wake flow field of a heavy-duty truck[J]. 吉林大学学报(工学版), 2013, 43(03): 595 -601 .
[5] WANG Tong-jian, CHEN Jin-shi, ZHAO Feng, ZHAO Qing-bo, LIU Xin-hui, YUAN Hua-shan. Mechanical-hydraulic co-simulation and experiment of full hydraulic steering systems[J]. 吉林大学学报(工学版), 2013, 43(03): 607 -612 .
[6] ZHANG Chun-qin, JIANG Gui-yan, WU Zheng-yan. Factors influencing motor vehicle travel departure time choice behavior[J]. 吉林大学学报(工学版), 2013, 43(03): 626 -632 .
[7] MA Wan-jing, XIE Han-zhou. Integrated control of main-signal and pre-signal on approach of intersection with double stop line[J]. 吉林大学学报(工学版), 2013, 43(03): 633 -639 .
[8] YU De-xin, TONG Qian, YANG Zhao-sheng, GAO Peng. Forecast model of emergency traffic evacuation time under major disaster[J]. 吉林大学学报(工学版), 2013, 43(03): 654 -658 .
[9] XIAO Yun, LEI Jun-qing, ZHANG Kun, LI Zhong-san. Fatigue stiffness degradation of prestressed concrete beam under multilevel amplitude cycle loading[J]. 吉林大学学报(工学版), 2013, 43(03): 665 -670 .
[10] XIAO Rui, DENG Zong-cai, LAN Ming-zhang, SHEN Chen-liang. Experiment research on proportions of reactive powder concrete without silica fume[J]. 吉林大学学报(工学版), 2013, 43(03): 671 -676 .