吉林大学学报(工学版) ›› 2016, Vol. 46 ›› Issue (6): 2111-2115.doi: 10.13229/j.cnki.jdxbgxb201606047

Previous Articles     Next Articles

Exemplar bidirectional matching algorithm for image inpainting

LIU Hong-xi1, 3, SUN Jun-xi2, SUN Hong-bin1, LIU Guang-wen3   

  1. 1.School of Electrical and Information Engineering, Changchun Institute of Technology, Changchun 130012,China;
    2.School of Computer Science and Information Technology, Northeast Normal University, Changchun 130017,China;
    3.School of Electronics and Information Engineering, Changchun University of Science and Technology, Changchun 130022,China
  • Received:2015-03-22 Online:2016-11-20 Published:2016-11-20

PDF (PC)

420

Abstract: In order to solve the issue mismatching and structure disconnecting in exemplar-based image inpainting, an exemplar bidirectional matching algorithm for image inpainting is proposed. The neighborhoods of known and unknown regions in the repairing patch are investigated. The consistency criterion of the unknown region corresponding information in the matching patch and in the repairing patch is adopted. The priority of the repairing patch and the best matching patch are determined by the similarity of the known information and the consistency of the unknown information in the repairing patch. The known information of the image is sufficiently used. It can effectively solve the problems of mismatching and structure disconnecting in Criminis algorithm and the problem of blurring in Kawai algorithm. Experimental results demonstrate the effectiveness of the proposed algorithm.

Key words: information processing technology, image inpainting, exemplar patches, bidirectional matching

CLC Number: 

  • TN919
[1] Criminisi A, Patrick P, Kentaro T. Region filling and object removal by exemplar-based image inpainting[J]. IEEE Transactions on Image Processing, 2004,13(9): 1200-1212.
[2] Norihiko K, Tomokazu S, Naokazu Y. Image inpainting considering brightness change and spatial locality of textures and its evaluation[C]∥Proceedings of the 3rd Pacific Rim Symposium on Advances in Image and Video Technology, Berlin, Heidelberg, 2009:271-282.
[3] Komodakis N, Tziritas G. Image completion using efficient belief propagation via priority scheduling and dynamic pruning[J]. IEEE Transactions on Image Processing,2007,16(11):2649-2661.
[4] Shibata T, Akihiko I, Senda S. Image inpainting based on probabilistic structure estimation[C]∥10th Asian Conference on Computer Vision, Queenstown, New Zealand, 2010:109-120.
[5] Wong A, Orchard J. A nonlocal-means approach to exemplar-based inpainting[C]∥15th IEEE Inter-national Conference on Image Processing,San Diego,CA,USA, 2008:2600-2603.
[6] Wexler Y, Shechtman E, Irani M. Space-time completion of video[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2007,29(3):463-476.
[7] Arias P, Gabriele F, Vicent C, et al. A variational framework for exemplar-based image inpainting[J]. International Journal of Computer Vision,2011,9(3):319-347.
[8] Cao F, Gousseau Y, Masnou S, et al. Geometrically guided exemplar-based inpainting[J]. SIAM Journal on Imaging Sciences,2011,4(4):1143-1179.
[9] He K, Sun J. Statistics of patch offsets for image completion[C]∥12th European Conference on Computer Vision, Florence, Italy, 2012:16-29.
[10] 何凯,张丽莹,高俊俏. 一种稳健的基于等照度线的图像修复算法[J]. 吉林大学学报:工学版,2016,46(3):929-933.
He Kai,Zhang Li-ying,Gao Jun-qiao, A robust image inpainting algorithm based on isophote[J]. Journal of Jilin University(Engineering and Technology Edition),2016,46(3):929-933.
[11] 李志丹,和红杰,陈帆,等. 联合4方向特征的全局优化图像补全[J]. 光学精密工程,2015,23(4):1171-1178.
Li Zhi-dan,He Hong-jie,Chen Fan,et al. Image completion with global optimization based on four-direction features[J]. Optics and Precision Engineering,2015,23(4):1171-1178.
[12] 邓承志,刘娟娟,汪胜前,等.保留结构特征的稀疏性正则化图像修复[J].光学精密工程,2013,21(7):1906-1913.
Deng Cheng-zhi, Liu Juan-juan, Wang Sheng-qian, et al. Feature retained image inpainting based on sparsity regularization[J].Optics and Precision Engineering,2013,21(7):1906-1913.
[13] Questionnaire and RMSE evaluation for image inpainting[DB/OL].[2015-01-28].http:∥yokoya.naist.jp/research/inpainting/.
[1] YING Huan,LIU Song-hua,TANG Bo-wen,HAN Li-fang,ZHOU Liang. Efficient deterministic replay technique based on adaptive release strategy [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1917-1924.
[2] LIU Zhong-min,WANG Yang,LI Zhan-ming,HU Wen-jin. Image segmentation algorithm based on SLIC and fast nearest neighbor region merging [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1931-1937.
[3] SHAN Ze-biao,LIU Xiao-song,SHI Hong-wei,WANG Chun-yang,SHI Yao-wu. DOA tracking algorithm using dynamic compressed sensing [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1938-1944.
[4] YAO Hai-yang, WANG Hai-yan, ZHANG Zhi-chen, SHEN Xiao-hong. Reverse-joint signal detection model with double Duffing oscillator [J]. 吉林大学学报(工学版), 2018, 48(4): 1282-1290.
[5] QUAN Wei, HAO Xiao-ming, SUN Ya-dong, BAI Bao-hua, WANG Yu-ting. Development of individual objective lens for head-mounted projective display based on optical system of actual human eye [J]. 吉林大学学报(工学版), 2018, 48(4): 1291-1297.
[6] CHEN Mian-shu, SU Yue, SANG Ai-jun, LI Pei-peng. Image classification methods based on space vector model [J]. 吉林大学学报(工学版), 2018, 48(3): 943-951.
[7] CHEN Tao, CUI Yue-han, GUO Li-min. Improved algorithm of multiple signal classification for single snapshot [J]. 吉林大学学报(工学版), 2018, 48(3): 952-956.
[8] MENG Guang-wei, LI Rong-jia, WANG Xin, ZHOU Li-ming, GU Shuai. Analysis of intensity factors of interface crack in piezoelectric bimaterials [J]. 吉林大学学报(工学版), 2018, 48(2): 500-506.
[9] LIN Jin-hua, WANG Yan-jie, SUN Hong-hai. Improved feature-adaptive subdivision for Catmull-Clark surface model [J]. 吉林大学学报(工学版), 2018, 48(2): 625-632.
[10] WANG Ke, LIU Fu, KANG Bing, HUO Tong-tong, ZHOU Qiu-zhan. Bionic hypocenter localization method inspired by sand scorpion in locating preys [J]. 吉林大学学报(工学版), 2018, 48(2): 633-639.
[11] YU Hua-nan, DU Yao, GUO Shu-xu. High-precision synchronous phasor measurement based on compressed sensing [J]. 吉林大学学报(工学版), 2018, 48(1): 312-318.
[12] WANG Fang-shi, WANG Jian, LI Bing, WANG Bo. Deep attribute learning based traffic sign detection [J]. 吉林大学学报(工学版), 2018, 48(1): 319-329.
[13] LIU Dong-liang, WANG Qiu-shuang. Instantaneous velocity extraction method on NGSLM data [J]. 吉林大学学报(工学版), 2018, 48(1): 330-335.
[14] TANG Kun, SHI Rong-hua. Detection of wireless sensor network failure area based on butterfly effect signal [J]. 吉林大学学报(工学版), 2017, 47(6): 1939-1948.
[15] LI Juan, MENG Ke-xin, LI Yue, LIU Hui-li. Seismic signal noise suppression based on similarity matched Wiener filtering [J]. 吉林大学学报(工学版), 2017, 47(6): 1964-1968.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
[1] XIAO Yun, LEI Jun-qing, ZHANG Kun, LI Zhong-san. Fatigue stiffness degradation of prestressed concrete beam under multilevel amplitude cycle loading[J]. 吉林大学学报(工学版), 2013, 43(03): 665 -670 .
[2] ZHOU Feng-dao, TANG Hong-zhong, GUO Xin, WANG Jin-yu. Current overshoot produce principle and inhibition of transmitter of time domain electromagnetic detection system[J]. 吉林大学学报(工学版), 2013, 43(04): 1023 -1028 .
[3] LIU Shao-gang, GUO Yun-long, JIA He-ming. Rescue robot simultaneous localization and mapping based on extraction and matching of line features[J]. 吉林大学学报(工学版), 2013, 43(04): 1035 -1044 .
[4] LI Zhan-shan, ZHANG Liang, GUO Jin-song, ZHANG Qian. Boundary heuristic based on problem structure[J]. 吉林大学学报(工学版), 2013, 43(04): 1045 -1051 .
[5] SANG Ai-jun, MU Sen, WANG Mo-lin, CUI Hai-ting, CHEN He-xin. Multi-view video coding based on multi-dimensional vector matrix[J]. 吉林大学学报(工学版), 2013, 43(04): 1110 -1115 .
[6] TONG Jin, WANG Ya-hui, FAN Xue-mei, ZHANG Shu-jun, CHEN Dong-hui. Monitoring system of cold chain logistics for farm fresh produce[J]. 吉林大学学报(工学版), 2013, 43(06): 1707 -1711 .
[7] LIN Jun,FU Lei,WANG Yan-zhang,XU Jiang,JI Yan-ju,YANG Meng-meng. Development of sensor used for grounded electrical source air-ground transient electromagnetic detection[J]. 吉林大学学报(工学版), 2014, 44(3): 888 -894 .
[8] GAO Zhen-hai, LI Yang, ZHANG Hui, ZHANG Li-dan, HU Hong-yu. Driver's forward-looking behavior analysis during lane change under different speed[J]. 吉林大学学报(工学版), 2016, 46(5): 1385 -1390 .
[9] SU Chang, FU Li-ming, WEI Jun, LI Shuo, HUANG Lei, CAO Yue. Design method in exterior color based Kansei engineering and principal component analysis[J]. 吉林大学学报(工学版), 2016, 46(5): 1414 -1419 .
[10] LANG Li-hui, WANG Yao, LI Kui, SUN Zhi-ying, ZHANG Quan-da. Factors influencing inverse bulging effect in sheet hydroforming[J]. 吉林大学学报(工学版), 2016, 46(5): 1567 -1576 .
Copyright © Journal of Jilin University(Engineering and Technology Edition), All Rights Reserved.
Tel: +86-431-85095297　Fax: +86-431-85094074　E-mail: xbgxb@jlu.edu.cn
Powered by Beijing Magtech Co. Ltd