Journal of Jilin University(Engineering and Technology Edition) ›› 2023, Vol. 53 ›› Issue (12): 3536-3546.doi: 10.13229/j.cnki.jdxbgxb.20220048

Previous Articles    

Ordinal cross entropy Hashing based on generative adversarial network

Zhen WANG1,2(),Xiao-han YANG1,Nan-nan WU1,Guo-kun LI1,Chuang FENG1   

  1. 1.School of Computer Science and Technology，Shandong University of Technology，Zibo 255022，China
    2.Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education，Jilin University，Changchun 130012，China
  • Received:2022-01-11 Online:2023-12-01 Published:2024-01-12

RICH HTML

 2   

PDF (PC)

131

Abstract:

To fast respond the large scale RS image search task， the deep generative adversarial learning ordinal cross entropy Hashing （GANOCH） was proposed. Firstly， the ordinal relation preserving objective function was established based on cross entropy， then the triplet similarity relationship owned the same probability distribution in different spaces. As a result， the ability of preserving ordinal relation is enhanced. Then， to fix the NP hard problem， the discrete binary encoding was relaxed to the continuous representation. Furthermore， the quantization loss function was designed based on triplet ordinal cross entropy and the loss caused by the continuous mechanism was minimized. Finally， a supervised deep generative adversarial network was established to synthesize RS image dataset according to both label matrix and random noise. Thus， the over fitting problem is avoided. The final ANN search comparative experiments were conducted on three large scale datasets， and the proposed GANOCH achieved the best performance.

Key words: computer application technology, Hashing algorithm, cross entropy, ordinal relation preserving

CLC Number: 

  • TP391.41

Fig.1

Flowchart of generative adversarial learning ordinal cross entropy Hashing"

Fig.2

Recall curves on SAT4 dataset of various algorithms"

Fig.3

Recall curves on SAT6 dataset of various algorithms"

Fig.4

Recall curves on UCMD dataset of various algorithms"

Table 1

mAP values of neighbor retrieval performance of different algorithms on the SAT4 dataset"

长度/bitGANOCHTBHDCHPRHKMHITQSHLSH
640.59340.57680.48620.43610.39460.36570.34820.3407
1280.63750.61240.49860.45280.41730.38560.37240.3615
2560.65170.63450.51280.48570.43610.42850.41520.3986

Table 2

mAP values of neighbor retrieval performance of different algorithms on the SAT6 dataset"

长度/bitGANOCHTBHDCHPRHKMHITQSHLSH
640.60420.58260.49360.45860.41250.37640.36950.3628
1280.64390.62680.51740.47950.42810.39270.38640.3752
2560.68150.65270.53940.49720.45160.43590.42380.4175

Table 3

mAP values of neighbor retrieval performance of different algorithms on the UCMD dataset"

长度/bitGANOCHTBHDCHPRHKMHITQSHLSH
640.36270.34150.29170.24620.21350.19860.17240.1637
1280.48520.46380.39630.35270.28160.24620.20150.1842
2560.53940.49750.43190.37460.31680.26730.23510.2148

Fig.5

Comparison of ablation experiments results."

1 Shan Xue, Liu Ping-ping, Wang Yi-fan, et al. Deep Hashing using proxy loss on remote sensing image retrieval[J]. Remote Sensing, 2021, 13(15): No. 2924.
2 Shan Xue, Liu Ping-ping, Gou Gui-xia, et al. Deep hash remote sensing image retrieval with hard probability sampling[J]. Remote Sensing, 2020, 12(17): No. 2789.
3 冯小康, 彭延国, 崔江涛, 等. 基于最优排序局部敏感哈希索引[J]. 计算机学报, 2020, 43(5): 930-947.
Feng Xiao-kang, Peng Yan-guo, Cui Jiang-tao, et al. Locality sensitive Hashing index based on optimal linear order[J]. Chinese Journal of Computers, 2020, 43(5): 930-947.
4 赵宏伟, 王振, 杨文迪, 等. 熵选择多重二进制编码[J].吉林大学学报: 工学版, 2017, 47(1): 218-226.
Zhao Hong-wei, Wang Zhen, Yang Wen-di, et al. Multiple binary codes based on entropy selection[J]. Journal of Jilin University: Engineering and Technology Edition, 2017, 47(1): 218-226.
5 Hou Yong, Wang Qing-jun. Research and improvement of content based image retrieval framework[J]. International Journal of Pattern Recognition and Artificial Intelligence, 2018, 32(12): No.1850043.
6 Wang J, Liu W, Sanjiv K, et al. Learning to hash for indexing big data—a survey[J]. Proceedings of the IEEE, 2016, 104(1): 34-57.
7 Wang Jing-dong, Zhang Ting, Song Jing-kuan, et al. A survey on learning to hash[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2018, 40(4): 769-790.
8 Mayur D, Nicole I, Piotr I, et al. Locality-sensitive Hashing scheme based on p-stable distributions[C]∥Proceedings of the Annual Symposium on Computational Geometry, New York, USA, 2004: 253-262.
9 Weiss Y, Torralba A, Fergus R. Spectral Hashing[C]∥Proceedings of the Advances in Neural Information Processing Systems, British Columbia, Canada, 2008: 1753-1760.
10 Gong Y C, Svetlana L. Iterative quantization: a procrustean approach to learning binary codes[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), CO, USA, 2011: 817-824.
11 He Kai-ming, Wen Fang, Sun Jian. K-means Hashing: an affinity-preserving quantization method for learning binary compact codes[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), OR, USA, 2013: 2938-2945.
12 Cao Yue, Long Ming-sheng, Liu Bin, et al. Deep Cauchy Hashing for Hamming space retrieval[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), UT, USA, 2018: 1229-1237.
13 Shen Yu-min, Qin Jie, Chen Jia-xin, et al. Auto-encoding twin-bottleneck Hashing[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), WA, USA, 2020: 2815-2824.
14 Li Peng, Ren Peng. Partial randomness Hashing for large-scale remote sensing image retrieval[J]. IEEE Geoscience & Remote Sensing Letters, 2017, 14(3): 464-468.
15 He Jun-feng, Liu Wei, Chang Shih-fu. Scalable similarity search with optimized kernel Hashing[C]∥Proceedings of the ACM International Conference on Knowledge Discovery and Data Mining, Washington, DC, USA, 2010: 1129-1138.
16 Liu Hao-miao, Wang Rui-ping, Shan Shi-guang, et al. Deep supervised Hashing for fast image retrieval[J]. IEEE Conference on Computer Vision and Pattern Recognition, 2016, 127(9): 2064-2072.
17 Li Yan-sheng, Zhang Yong-jun, Huang Xin, et al. Large-scale remote sensing image retrieval by deep Hashing neural networks[J]. IEEE Transactions on Geoscience and Remote Sensing, 2017, 56(2): 950-965.
18 Fan Li-li, Zhao Hong-wei, Zhao Hao-yu. Distribution consistency loss for large-scale remote sensing image retrieval[J]. Remote Sensing, 2020, 12(1): No. 175.
19 Kamran G, Zheng F, Najmeh S, et al. Unsupervised deep generative adversarial Hashing network[C]∥Proceedings of the Conference on Computer Vision and Pattern Recognition, UT, USA, 2018: 3664-3673.
20 Radford A, Metz L, Chintala S. Unsupervised representation learning with deep convolutional generative adversarial networks[C]∥Proceedings of the International Conference on Learning Representations, San Juan, Puerto Rico, 2016: No.06434.
21 Cao Yue, Liu Bin, Long Ming-sheng, et al. HashGAN: Deep learning to hash with pair conditional wasserstein GAN[C]∥Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA, 2018:1287-1296.
22 Martín A, Soumith C, Léon B. Wasserstein generative adversarial networks[C]∥Proceedings of the International Conference on Machine Learning 2017, Sydney, NSW, Australia, 2017: 214-223.
23 Augustus O, Christopher O, Jonathon S. Conditional image synthesis with auxiliary classifier GANs[C]∥Proceedings of the International Conference on Machine Learning, Sydney, NSW, Australia, 2017: 4043-4055.
24 Alex K, Ilya S, Geoffrey E H. Image-Net classification with deep convolutional neural networks[C]∥Proceedings of the NIPS, Nevada, United States, 2012: 1106-1114.
25 Yang Y, Shawn D N. Bag-of-visual-words and spatial extensions for land-use classification[C]∥Proceedings of the International Conference on Advances in Geographic Information Systems, Association for Computing Machinery, San Jose, California, 2010:270-279.
26 Saikat B, Sangram G, Supratik M, et al. DeepSat: a learning framework for satellite imagery[C]∥Proceedings of the International Conference on Advances in Geographic Information Systems, Association for Computing Machinery, Seattle, Washington, 2015: 1-10.
[1] Ya-hui ZHAO,Fei-yu LI,Rong-yi CUI,Guo-zhe JIN,Zhen-guo ZHANG,De LI,Xiao-feng JIN. Korean⁃Chinese translation quality estimation based on cross⁃lingual pretraining model [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(8): 2371-2379.
[2] Shan XUE,Ya-liang ZHANG,Qiong-ying LYU,Guo-hua CAO. Anti⁃unmanned aerial vehicle system object detection algorithm under complex background [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 891-901.
[3] Feng-feng ZHOU,Zhen-wei YAN. A model for identifying neuropeptides by feature selection based on hybrid features [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(11): 3238-3245.
[4] Jun-jie WANG,Yuan-jun NONG,Li-te ZHANG,Pei-chen ZHAI. Visual relationship detection method based on construction scene [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(1): 226-233.
[5] Bing ZHU,Zi-wei LI,Qi LI. Building segmentation method of remote sensing image based on improved SegNet [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(1): 248-254.
[6] Gui-he QIN,Jun-feng HUANG,Ming-hui SUN. Text input based on two⁃handed keyboard in virtual environment [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(8): 1881-1888.
[7] Tian BAI,Ming-wei XU,Si-ming LIU,Ji-an ZHANG,Zhe WANG. Dispute focus identification of pleading text based on deep neural network [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(8): 1872-1880.
[8] Fu-heng QU,Tian-yu DING,Yang LU,Yong YANG,Ya-ting HU. Fast image codeword search algorithm based on neighborhood similarity [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(8): 1865-1871.
[9] Ming LIU,Yu-hang YANG,Song-lin ZOU,Zhi-cheng XIAO,Yong-gang ZHANG. Application of enhanced edge detection image algorithm in multi-book recognition [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(4): 891-896.
[10] Shi-min FANG. Multiple source data selective integration algorithm based on frequent pattern tree [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(4): 885-890.
[11] Sheng-sheng WANG,Chen-xu LI,Xiang-yu WANG,Zhi-lin YAO,Yi-shen LIU,Jia-qian WU,Qing-ran YANG. Brain tumor image classification based on improved residual capsule network and sparrow search [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(11): 2653-2661.
[12] Xiang-jiu CHE,He-yuan CHEN. Muti⁃Object dishes detection algorithm based on improved YOLOv4 [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(11): 2662-2668.
[13] Sheng-sheng WANG,Jing-yu CHEN,Yi-nan LU. COVID⁃19 chest CT image segmentation based on federated learning and blockchain [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(6): 2164-2173.
[14] Hong-wei ZHAO,Zi-jian ZHANG,Jiao LI,Yuan ZHANG,Huang-shui HU,Xue-bai ZANG. Bi⁃direction segmented anti⁃collision algorithm based on query tree [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(5): 1830-1837.
[15] Jie CAO,Xue QU,Xiao-xu LI. Few⁃shot image classification method based on sliding feature vectors [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(5): 1785-1791.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright © Journal of Jilin University(Engineering and Technology Edition), All Rights Reserved.
Tel: +86-431-85095297　Fax: +86-431-85094074　E-mail: xbgxb@jlu.edu.cn
Powered by Beijing Magtech Co. Ltd