Journal of Jilin University(Engineering and Technology Edition) ›› 2024, Vol. 54 ›› Issue (7): 2080-2085.doi: 10.13229/j.cnki.jdxbgxb.20230039

Previous Articles    

Multi spectral image matching algorithm of unmanned aerial vehicle based on affine invariant operator

Yi TANG1,2(),Yang PAN1,2(),Ming GAO3,Hong-chen YI1,An-qi WEI1   

  1. 1.School of Environmental Science and Engineering，Suzhou University of Science and Technology，Suzhou 215009，China
    2.National and Local Joint Engineering Laboratory of Urban Domestic Sewage Recycling Technology，Suzhou University of Science and Technology，Suzhou 215009，China
    3.School of Mechanical Engineering，Sichuan University，Chengdu 610065，China
  • Received:2023-01-26 Online:2024-07-01 Published:2024-08-05
  • Contact: Yang PAN E-mail:zzz200399@yeah.net;panyang@mail.usts.edu.cn

RICH HTML

 0   

PDF (PC)

44

Abstract:

The traditional unmanned aerial vehicle （UAV） multispectral image matching algorithm has some problems， such as low matching accuracy， low matching accuracy， and poor overall effect. In order to solve the problems in traditional methods， a UAV multispectral image matching algorithm based on affine invariant operator is proposed. Firstly， the UAV multispectral image is enhanced by histogram equalization method， and the affine invariant region of the UAV multispectral image is extracted by affine invariant operator； Secondly， corner detection and feature point extraction of UAV multispectral image are completed by multi-scale product LoG method； Finally， the shape description operator is used to describe the image feature points， and the Gaussian weighted distance algorithm is used to complete the final image matching. The experimental results show that the proposed method has higher accuracy， smaller error and better overall effect for UAV multispectral image matching.

Key words: affine invariant operator, unmanned aerial vehicle, multi spectral image, image matching, feature point extraction

CLC Number: 

  • TP391.41

Fig.1

Experimental objects"

Fig.2

Results of correct matching points of three algorithms"

Table 1

Statistics of matching data of three algorithms"

参数文献［3］算法文献［4］算法本文算法
描述时间/ms159522081109
匹配时间/ms194519541177
平均匹配误差0.99560.99980.8810
1 眭海刚,刘畅,干哲,等.多模态遥感图像匹配方法综述[J].测绘学报,2022,519:1848-1861.
Sui Hai-gang, Liu Chang, Gan Zhe, et al. Overview of multi-modal remote sensing image matching methods[J]. Acta Geodaetica et Cartographica Sinica, 2022,51(9): 1848-1861.
2 郝帅,吴瑛琦,马旭,等.基于CycleGAN-SIFT的可见光和红外图像匹配[J].光学精密工程,2022,30(5):602-614.
Hao Shuai, Wu Ying-qi, Ma Xu, et al. Visible and infrared image matching based on CycleGAN-SIFT[J]. Optics and Precision Engineering, 2022,30(5): 602-614.
3 王昱皓,唐泽恬,钟岷哲,等.基于掩模搜索的快速尺度不变特征变换图像匹配算法[J].激光与光电子学进展,2021,58(4):175-181.
Wang Yu-hao, Tang Ze-tian, Zhong Min-zhe, et al. Image matching algorithm for fast scale-invariant feature transformation based on mask search[J].Laser & Optoelectronics Progress, 2021,58(4): 175-181.
4 高莎,袁希平,甘淑,等.集成SIFT算法与检测模型优化的UAV影像匹配方法[J].光谱学与光谱分析,2022,42(5):1497-1503.
Gao Sha, Yuan Xi-ping, Gan Shu, et al. UAV image matching method integrating SIFT algorithm and detection model optimization[J]. Spectroscopy and Spectral Analysis, 2022,42(5): 1497-1503.
5 岳振宇,范大昭,董杨,等.一种星载平台轻量化快速影像匹配方法[J].地球信息科学学报,2022,24(5):925-939.
Yue Zhen-yu, Fan Da-zhao, Dong Yang, et al.A generation method of spaceborne lightweight and fast matching[J]. Journal of Geo-information Science, 2022, 24(5): 925-939.
6 黄淑英,胡威,杨勇,等.基于渐进式双网络模型的低曝光图像增强方法[J].计算机学报,2021,44(2):384-394.
Huang Shu-ying, Hu Wei, Yang Yong, et al.A low-exposure image enhancement based on progressive dual network model[J]. Chinese Journal of Computers, 2021, 44(2): 384-394.
7 路皓翔,刘振丙,张静,等.结合多尺度循环卷积和多聚类空间的红外图像增强[J].电子学报,2022,50(2):415-425.
Lu Hao-xiang, Liu Zhen-bing, Zhang Jing, et al. Infrared image enhancement based on multi-scale cyclic convolution and multi-clustering space[J]. Acta Electronica Sinica, 2022, 50(2): 415-425.
8 张传辉,姚国标,张力,等.多分支网络联合的倾斜影像仿射不变特征匹配[J].测绘学报, 2021, 50(5):641-651.
Zhang Chuan-hui, Yao Guo-biao, Zhang Li, et al. Affine invariant feature matching of oblique images based on multi-branch network[J]. Acta Geodaetica et Cartographica Sinica, 2021, 50(5): 641-651.
9 陈玲玲,周旭东,谢傢成,等.快速仿射非局部均值图像去噪[J].图学学报, 2021, 42(5):762-766.
Chen Ling-ling, Zhou Xu-dong, Xie Jia-cheng, et al. Fast affine non-local means image denosing[J]. Journal of Graphics, 2021, 42(5): 762-766.
10 朱代先,吴栋,刘树林,等.AKAZE结合自适应局部仿射匹配的视差图像特征匹配算法[J].应用光学,2021, 42(6):1048-1055.
Zhu Dai-xian, Wu Dong, Liu Shu-lin, et al. Disparity image feature matching algorithm based on AKAZE and adaptive local affine matching[J]. Journal of Applied Optics, 2021,42(6): 1048-1055.
11 王丁丁,王万银,朱莹洁,等.位场边缘识别特征点提取方法及应用[J].地球物理学报,2021,64(4):1401-1411.
Wang Ding-ding, Wang Wan-yin, Zhu Ying-jie, et al. Extraction methods and application of feature points of edge recognition for potential field[J]. Chinese Journal of Geophysics, 2021,64(4): 1401-1411.
12 王辉,袁杰.改进的均匀化AGAST特征提取算法[J].电光与控制,2022,29(5):33-38.
Wang Hui, Yuan Jie. An improved homogenized AGAST feature extraction algorithm[J]. Electronics Optics & Control, 2022,29(5): 33-38.
13 刘磊,邹媛媛,陈泊璇.二维形状特征描述及分类识别研究进展综述[J].计算机工程与应用,2021,57(14):39-47.
Liu Lei, Zou Yuan-yuan, Chen Bo-xuan. Review on research progress of 2D shape description and classification[J]. Computer Engineering and Applications, 2021, 57(14): 39-47.
14 曹明兰,李亚东,李长青,等.VDVI与AKAZE结合的无人机森林影像匹配方法[J].中南林业科技大学学报, 2021, 41(8):1-8.
Cao Ming-lan, Li Ya-dong, Li Chang-qing,et al. Forest image matching method of unmanned aerial vehicle based on the combination of VDVI and AKAZE[J]. Journal of Central South University of Forestry & Technology, 2021, 41(8): 1-8.
15 陆可,郑伯桢,卢春盛,等.基于数学形态学改进的无人机影像配准算法[J].合肥工业大学学报:自然科学版,2021, 44(10):1406-1412, 1419.
Lu Ke, Zheng Bo-zhen, Lu Chun-sheng,et al. Improved UAV image registration algorithm based on mathematical morphology[J]. Journal of Hefei University of Technology (Natural Science), 2021,44(10): 1406-1412, 1419.
[1] Bin XIAN,Guang-yi WANG,Jia-ming CAI. Nonlinear robust control design for multi unmanned aerial vehicles suspended payload transportation system [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(6): 1788-1795.
[2] Dian-wei WANG,Chi ZHANG,Jie FANG,Zhi-jie XU. UAV target tracking algorithm based on high resolution siamese network [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(5): 1426-1434.
[3] Ya-jing YU,Jian GUO,Rong-hao WANG,Wei QIN,Ming-wu SONG,Zheng-rong XIANG. Time⁃varying formation control of multi⁃quadrotor unmanned aerial vehicles based on state observer [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 871-882.
[4] Shan XUE,Ya-liang ZHANG,Qiong-ying LYU,Guo-hua CAO. Anti⁃unmanned aerial vehicle system object detection algorithm under complex background [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 891-901.
[5] Ying HE,Jun-song FAN,Wei WANG,Geng SUN,Yan-heng LIU. Joint optimization of secure communication and trajectory planning in unmanned aerial vehicle air⁃to⁃ground [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 913-922.
[6] Guo-yuan QI,Hao CHEN. Observer⁃based control⁃anti⁃disturbance⁃obstacle avoidance of quadrotor unmanned aerial vehicle [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 810-822.
[7] Hong-yang PAN,Zhao LIU,Bo YANG,Geng SUN,Yan-heng LIU. Overview of swarm intelligence methods for unmanned aerial vehicle systems based on new⁃generation information technology [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 629-642.
[8] Long-long CHEN,Tian-yu FENG,Zong-yang LYU,Yu-hu WU. Finite⁃time sliding mode attitude control for coaxial tilt⁃rotor unmanned aerial vehicle [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 883-890.
[9] Bin XIAN,Jie-qi LI,Xun GU. Ground effects compensation for an unmanned aerial vehicle via nonlinear disturbance observer [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(8): 1926-1933.
[10] Hang ZHU,Han-bo YU,Jia-hui LIANG,Hong-ze LI. Improved algorithm of UAV search based on electric field model and simulation analysis [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(12): 3029-3038.
[11] Bin XIAN,Shi-jing ZHANG,Xiao-wei HAN,Jia-ming CAI,Ling WANG. Trajectory planning for unmanned aerial vehicle slung⁃payload aerial transportation system based on reinforcement learning [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(6): 2259-2267.
[12] Rui-tao GAO,Jian SHAN,Zhou YANG,Sheng WEN,Yu-bin LAN,Quan-yong ZHANG,Yang WANG. Real⁃time interpretation system of variable spray prescription map based on plant protection UAV [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(1): 361-374.
[13] WU Wei-nan,CUI Nai-gang,GUO Ji-feng,ZHAO Yang-yang. Distributed integrated method for mission planning of heterogeneous unmanned aerial vehicles [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1827-1837.
[14] YANG Dong-sheng, ZHANG Zhan, LIAN Meng-jia, WANG Li-na. Matching binary feature search algorithm of bitmap locality sensitive hashing [J]. 吉林大学学报(工学版), 2018, 48(3): 893-902.
[15] QIU Chun-ling, TAO Qiang, FAN Run-long, WANG Pei-zhi. Zircon image matching method based on description of SIFT feature by LBP [J]. 吉林大学学报(工学版), 2014, 44(6): 1793-1798.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright © Journal of Jilin University(Engineering and Technology Edition), All Rights Reserved.
Tel: +86-431-85095297　Fax: +86-431-85094074　E-mail: xbgxb@jlu.edu.cn
Powered by Beijing Magtech Co. Ltd