吉林大学学报(工学版) ›› 2015, Vol. 45 ›› Issue (4): 1288-1296.doi: 10.13229/j.cnki.jdxbgxb201504038

Previous Articles     Next Articles

Electronic image stabilization algorithm for on board catadioptric omnidirectional vision system

ZHU Qi-dan, XU Cong-ying, CAI Cheng-tao   

  1. College of Automation, Harbin Engineering University, Harbin 150001,China
  • Received:2013-11-21 Online:2015-07-01 Published:2015-07-01

RICH HTML

0   

PDF (PC)

239

Abstract: An electronic image stabilization algorithm based on sea-sky line was presented to solve the slosh problem in the video acquired from the on board catadioptric omnidirectional vision system. Combing with the characteristics of sea-sky line in omnidirectional image, a feasible method based on optimal edge estimation was proposed to get the sea-sky line elliptic equation. The omnidirectional image stabilization model is built based on sea-sky line. The application of the sea-sky line image stabilization algorithm is introduced and the method of reconstructing the invalidated regions using sky frame is given. The actual test was carried out using sequential panoramic images, which were obtained in marine environment. Experimental results show that the proposed algorithm is fast and effective to solve video image stabilization for on board catadioptric omnidirectional vision system. The average computation time is less than 50 ms/frame, which has good application effect.

Key words: computer application, catadioptric omnidirectional vision, electronic image stabilization, sea-sky line extraction, image reconstruction

CLC Number: 

  • TP391
[1] Mondragod I F, Pascual C, Caro M, et al. Omnidirectional vision applied to unmanned aerial vehicles(UAVs)attitude and heading estimation[J]. Robotics and Autonomous Systems, 2010, 58(6): 809-819.
[2] Mariottini G L, Scheggi S, Morbidi F, et al. An accurate and robust visual-compass algorithm for robot-mounted omnidirectional cameras[J]. Robotics and Autonomous Systems, 2012, 60(9): 1179-1190.
[3] 蔡成涛,梁小龙,谭吉来,等. 自适应最优块匹配视频稳像算法[J]. 系统工程与电子技术,2013,35(6):1324-1329. Cai Cheng-tao, Liang Xiao-long, Tan Ji-lai, et al. Adaptive optimal block matching video stabilization algorithm[J]. Systems Engineering and Electronics, 2013, 35(6): 1324-1329.
[4] 仲训昱,朱齐丹,张 智. 数字稳像中的快速和鲁棒运动估计研究[J]. 电子学报,2010,38(1):251-256. Zhong Xun-yu, Zhu Qi-dan, Zhang Zhi. Study of fast and robust motion estimation in the digital image stabilization[J]. Acta Electronica Sinica, 2010, 38(1): 251-256.
[5] 邵向鑫,郭树旭,王朗. 基于边缘扩展相位相关的图像拼接算法[J]. 吉林大学学报: 信息科学版,2010,28(1):95-99. Shao Xiang-xin, Guo Shu-xu, Wang Lang. Image mosaic algorithm based on extended phase correlation of edge[J]. Journal of Jilin University:Information Science Edition, 2010, 28(1): 95-99.
[6] 王洪,戴明. 区域快速鲁棒特征跟踪电子稳像[J]. 吉林大学学报: 工学版,2012,42(2):451-458. Wang Hong, Dai Ming.Area speed up robust feature tracking for electric image stablization[J]. Journal of Jilin University: Information Science Edition, 2012, 42(2): 451-458.
[7] 朱娟娟,郭宝龙. 电子稳像的特征点跟踪算法[J]. 光学学报,2006,26(4):516-521. Zhu Juan-juan, Guo Bao-long. Features tracking algorithm for video stabilization[J]. Acta Optica Sinica, 2006, 26(4) : 516-521.
[8] Zhao H, Wang T. Image stabilization algorithm based on multi-bitplane[C]∥Proc of the International Symposium on Photo-electronic Detection and Imaging, Beijing,2009:73842Z.
[9] Tian S, Wang N, Zhao P, et al. Aims at moving objects improvement based on gray projection of algorithm of the electronic image stabilization[C]∥Proc of the 3th International Congress on Image and Signal Processing, Yantai,2010: 2483-2487.
[10] 赵红颖,晏磊,熊经武. 船载摄像系统的一种电子稳像算法[J]. 光学技术,2003, 29(5):628-633. Zhao Hong-ying, Yan Lei, Xiong Jing-wu. A new electronic image stabilizing algorithm for the image sequence of camera system on board[J]. Optical Technique,2003, 29(5): 628-633.
[11] Xue Y T, Wu T. A new horizon electronic image stabilization algorithm based on SVM[C]∥2010 International Conference on Optoelectronics and Image Processing, Haiko 2010: 59-63.
[12] Matsushita Y, Ofek E, Ge W N, et al. Full-frame video stabilization with motion inpainting[J]. IEEE Trans Pattern Analysis and Machine Intelligence, 2006, 7(28): 1150-1163.
[13] 马子岭,王建中. 折反射全景侦察系统电子稳像技术研究[J]. 北京理工大学学报,2010,30(12):1475-1479. Ma Zi-ling, Wang Jian-zhong. Research on electronic image stabilizing algorithm of catadioptric panoramic reconnaissance system[J]. Transactions of Beijing Institute of Technology, 2010, 30(12):1475-1479.
[14] 朱齐丹,马宏业,左小祥. 全景摄像系统中展开图像的电子稳像方法研究[J]. 计算机应用研究,2009,26(3):1192-1194. Zhu Qi-dan, Ma Hong-ye, Zuo Xiao-xiang. Electronic image stabilizing method research for developing image in omnidirectional camera system[J]. Application Research of Computers, 2009, 26(3): 1192-1194.
[15] Baker S, Nayar S. A theory of catadioptric image formation[C]∥Sixth International Conference on Computer Vision, Bombay,1998: 35-42.
[16] Mei F, Yue G X, Yu Q C. The study on an application of otsu method in canny operator[C]∥Proceedings of the 2009 International Symposium on Information Processing, Huangshan,2009 : 109-112.
[17] 谭郁松,周兴铭. 保持连通的边缘细化算法[J]. 国防科技大学学报,2004,26(4):51-56. Tan Yu-song, Zhou Xing-ming. Connectivity preserved edge thinning algorithm[J]. Journal of National University of Defense Technology, 2004, 26(4): 51-56.
[1] LIU Fu,ZONG Yu-xuan,KANG Bing,ZHANG Yi-meng,LIN Cai-xia,ZHAO Hong-wei. Dorsal hand vein recognition system based on optimized texture features [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1844-1850.
[2] WANG Li-min,LIU Yang,SUN Ming-hui,LI Mei-hui. Ensemble of unrestricted K-dependence Bayesian classifiers based on Markov blanket [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1851-1858.
[3] JIN Shun-fu,WANG Bao-shuai,HAO Shan-shan,JIA Xiao-guang,HUO Zhan-qiang. Synchronous sleeping based energy saving strategy of reservation virtual machines in cloud data centers and its performance research [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1859-1866.
[4] ZHAO Dong,SUN Ming-yu,ZHU Jin-long,YU Fan-hua,LIU Guang-jie,CHEN Hui-ling. Improved moth-flame optimization method based on combination of particle swarm optimization and simplex method [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1867-1872.
[5] LIU En-ze,WU Wen-fu. Agricultural surface multiple feature decision fusion disease judgment algorithm based on machine vision [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1873-1878.
[6] OUYANG Dan-tong, FAN Qi. Clause-level context-aware open information extraction [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(5): 1563-1570.
[7] LIU Fu, LAN Xu-teng, HOU Tao, KANG Bing, LIU Yun, LIN Cai-xia. Metagenomic clustering method based on k-mer frequency optimization [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(5): 1593-1599.
[8] GUI Chun, HUANG Wang-xing. Network clustering method based on improved label propagation algorithm [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(5): 1600-1605.
[9] LIU Yuan-ning, LIU Shuai, ZHU Xiao-dong, CHEN Yi-hao, ZHENG Shao-ge, SHEN Chun-zhuang. LOG operator and adaptive optimization Gabor filtering for iris recognition [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(5): 1606-1613.
[10] CHE Xiang-jiu, WANG Li, GUO Xiao-xin. Improved boundary detection based on multi-scale cues fusion [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(5): 1621-1628.
[11] ZHAO Hong-wei, LIU Yu-qi, DONG Li-yan, WANG Yu, LIU Pei. Dynamic route optimization algorithm based on hybrid in ITS [J]. 吉林大学学报(工学版), 2018, 48(4): 1214-1223.
[12] HUANG Hui, FENG Xi-an, WEI Yan, XU Chi, CHEN Hui-ling. An intelligent system based on enhanced kernel extreme learning machine for choosing the second major [J]. 吉林大学学报(工学版), 2018, 48(4): 1224-1230.
[13] FU Wen-bo, ZHANG Jie, CHEN Yong-le. Network topology discovery algorithm against routing spoofing attack in Internet of things [J]. 吉林大学学报(工学版), 2018, 48(4): 1231-1236.
[14] CAO Jie, SU Zhe, LI Xiao-xu. Image annotation method based on Corr-LDA model [J]. 吉林大学学报(工学版), 2018, 48(4): 1237-1243.
[15] HOU Yong-hong, WANG Li-wei, XING Jia-ming. HTTP-based dynamic adaptive streaming video transmission algorithm [J]. 吉林大学学报(工学版), 2018, 48(4): 1244-1253.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright © Journal of Jilin University(Engineering and Technology Edition), All Rights Reserved.
Tel: +86-431-85095297　Fax: +86-431-85094074　E-mail: xbgxb@jlu.edu.cn
Powered by Beijing Magtech Co. Ltd