吉林大学学报(工学版) ›› 2016, Vol. 46 ›› Issue (2): 542-548.doi: 10.13229/j.cnki.jdxbgxb201602032

• Orginal Article • Previous Articles     Next Articles

Feature saliency constraint based image retrieval method

ZHAO Hong-wei1, 2, LI Qing-liang1, LIU Ping-ping1, 2, TANG Huan-yu1   

  1. 1.College of Computer Science and Technology, Jilin University, Changchun 130012,China;
    2.Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Center for Computer Fundamental Education,Jilin University, Changchun 130012,China
  • Received:2014-11-14 Online:2016-02-20 Published:2016-02-20

Abstract: Objective retrieval plays an important role in daily life, however the model "Bag of words" exists some problems for image retrieval. For example, the quantified visual words reduce the discriminative power of the local features and the model does not capture the spatial relationship among local features, thus affecting the retrieval performance. In order to realize objective retrieval in complex environment, a feature saliency constraint based image retrieval method is proposed. By locating the salient object, this method can enhance the discriminative power of the local features and capture the spatial relationship among local features. First, the salient regions are distilled and the features inside these regions are marked as salient features. Second, the image retrieval is performed with spatial pyramid model using the salient features. Finally, the distance ratio of any two pairs of the features in each image is computed using the pair of salient features of the query image and retrieval image; then, the ratios which meet the threshold are recorded and their average is calculated to obtain the final results. Experimental results show that the proposed method improves the accuracy of the retrieval significantly and reduces the computing time during the geometric verification.

Key words: image retrieval, Bag of Words model, spatial pyramid, geometric verification, saliency

CLC Number: 

  • TP391
[1] Han Jun-wei, Xu Ming, Li Xin, et al. Interactive object-based image retrieval and annotation on iPad[J]. Multimedia Tools and Applications, 2014,72(3):2275-2297.
[2] Li Zhen-wei, Zhang Jing, Liu Xin, et al. Creating the bag-of-words with spatial context information for image retrieval[J]. Applied and Meterials and Materials, 2014,556-562:4788-4791.
[3] Fischler M A, Bolles R C. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography[J].Communications of the ACM, 1981,24(6): 381-395.
[4] Philbin J, Chum O, Isard M, et al. Object retrieval with large vocabularies and fast spatial matching[C]//CVPR'07,IEEE Conference on, Minneapolis,MN,2007: 1-8.
[5] Perd'och M,Chum O,Matas J.Efficient representation of local geometry for large scale object retrieval[C]//2009 IEEE Conference on Computer Vision and Pattern Recognition,Miami,FL,2009:9-16.
[6] Jegou H, Douze M, Schmid C. Hamming embedding and weak geometric consistency for large scale image search[C]//10th European Conference on Computer Vision,Marseille,France,2008:304-317.
[7] Zhao W L, Wu X, Ngo C W. On the annotation of web videos by efficient near-duplicate search[J]. Multimedia, IEEE Transactions on, 2010,12(15): 448-461.
[8] Tsai S S, Chen D, Takacs G, et al. Fast geometric re-ranking for image-based retrieval[C]//Image Processing (ICIP), 2010 17th IEEE International Conference on,Hong Kong,2010:1029-1032.
[9] Lazebnik S, Schmid C, Ponce J. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories[C]//2006 IEEE Computer Society Conference on,New York,NY,2006:2169-2178.
[10] Chen X, Zhao H, Liu P, et al. Automatic salient object detection via maximum entropy estimation[J]. Optics Letters, 2013,38(10): 1727-1729.
[11] 吴晓雨, 何彦, 杨磊, 等. 基于改进形状上下文特征的二值图像检索[J]. 光学精密工程, 2015, 23(1): 302-309.
Wu Xiao-yu, He Yan, Yang Lei, et al. Binary image retrieval based on improved shape context algorithm[J]. Optics and Precision Engineering, 2015, 23(1): 302-309.
[12] 王灿进, 孙涛, 陈娟. 局部不变特征匹配的并行加速技术研究[J]. 液晶与显示, 2014, 29(2) 266-274.
Wang Can-jin, Sun Tao, Chen Juan. Binary image retrieval based on improved shape context algorithm[J]. Chinese Journal of Liquid Crystal and Displays , 2014, 29(2) 266-274.
[13] 田浩南, 张叶. 基于边缘及特征点匹配的立体图像质量评价[J]. 液晶与显示, 2015, 30(4) 666-672.
Tian Hao-nan, Zhang Ye. Quality evaluation of stereo image based on edge and characteristic point matching[J]. Chinese Journal of Liquid Crystal and Displays, 2015, 30(4) 666-672.
[14] Zhou W, Li H, Lu Y, et al. SIFT match verification by geometric coding for large-scale partial-duplicate web image search[J]. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), 2013,9(1):4.
[1] SU Han-song,DAI Zhi-tao,LIU Gao-hua,ZHANG Qian-fang. Saliency region detection combining absorbing Markov chain and manifold ranking [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1887-1894.
[2] LU Yan-fei, ZHANG Tao, ZHENG Jian, LI Ming, ZHANG Cheng. No-reference blurring image quality assessment based on local standard deviation and saliency map [J]. 吉林大学学报(工学版), 2016, 46(4): 1337-1343.
[3] ZHAO Hong-wei, LI Qing-liang, TANG Huan-yu, ZANG Xue-bai. Spatial verification method based on local regional constraint [J]. 吉林大学学报(工学版), 2016, 46(1): 265-270.
[4] ZHANG Wen-jie, XIONG Qing-yu. Image salient region detection algorithm based on contrast and spatial location [J]. 吉林大学学报(工学版), 2015, 45(5): 1709-1716.
[5] ZHAO Dan-feng, WANG Bo, YANG Da-wei. Content-aware image resizing based on random permutation [J]. 吉林大学学报(工学版), 2015, 45(4): 1324-1328.
[6] WANG Xiao-wen, ZHAO Zong-gui, PANG Xiu-mei, LIU Min. Image fusion method based on visual saliency maps [J]. 吉林大学学报(工学版), 2014, 44(4): 1203-1208.
[7] LI Xiong-fei, ZHAO Hao-yu, CHEN Xiao, ZHAO Hong-wei. Irregular shape object segmentation based on visual feature [J]. 吉林大学学报(工学版), 2014, 44(4): 1140-1144.
[8] ZHAO Shi-jie, HAN Jun-wei, HE Sheng, CHENG Gong, GUO Lei. Video saliency computational model and its application in video advertising [J]. 吉林大学学报(工学版), 2014, 44(01): 235-240.
[9] JI Chao, LIU Hui-ying, SUN Jing-feng, HE Sheng, HUANG Min-zhu. Image salient region detection based on spatial and frequency domains [J]. 吉林大学学报(工学版), 2014, 44(01): 177-183.
[10] DONG Ao-shuang, SONG Hong-liang. Image retrieval technology based on SIFT feature and color fusion [J]. 吉林大学学报(工学版), 2013, 43(增刊1): 440-444.
[11] ZHAO Hong-wei, CHEN Xiao, SHI Jing-hai, MA Ling-jiao. Traffic sign image retrieval algorithm using integrated color and shape features [J]. 吉林大学学报(工学版), 2013, 43(增刊1): 128-132.
[12] ZHANG Jiu-wen, MI Jin-cai, ZHANG Tong-feng. Texture image retrieval based on DT-CWT and generalized gaussian density [J]. 吉林大学学报(工学版), 2013, 43(增刊1): 60-63.
[13] ZHANG Xu, GUO Bao-long, MENG Fan-jie, SUN Wei. Image retrieval based on IPDSH and region division [J]. 吉林大学学报(工学版), 2013, 43(05): 1408-1414.
[14] FENG Ying-ben, CHEN Hui. Sensorless drive of surface-mounted PMSM for EPS based on high-frequency signal injection [J]. 吉林大学学报(工学版), 2011, 41(增刊2): 65-69.
[15] CHEN Mian-shu, YANG Shu-yuan, ZHAO Zhi-jie, FU Ping, et al. Multi-points diverse density learning algorithm and its application in image retrieval [J]. 吉林大学学报(工学版), 2011, 41(05): 1456-1460.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!