吉林大学学报(工学版) ›› 2015, Vol. 45 ›› Issue (4): 1288-1296.doi: 10.13229/j.cnki.jdxbgxb201504038

• • 上一篇    下一篇

船载折反射全景视觉系统电子稳像算法

朱齐丹, 徐从营, 蔡成涛   

  1. 哈尔滨工程大学 自动化学院,哈尔滨 150001
  • 收稿日期:2013-11-21 出版日期:2015-07-01 发布日期:2015-07-01
  • 作者简介:朱齐丹(1963-),男,教授,博士生导师.研究方向:智能机器人,先进控制理论及应用.E-mail:zhuqidan@hrbeu.edu.cn
  • 基金资助:
    国家自然科学基金项目(61175089,61203255); 中央高校基本科研业务费专项资金项目(HEUCF110423,HEUCFZ1210); 博士后研究人员落户黑龙江科研启动资助金资助课题(LBH-Q11135)

Electronic image stabilization algorithm for on board catadioptric omnidirectional vision system

ZHU Qi-dan, XU Cong-ying, CAI Cheng-tao   

  1. College of Automation, Harbin Engineering University, Harbin 150001,China
  • Received:2013-11-21 Online:2015-07-01 Published:2015-07-01

RICH HTML

0   

PDF (PC)

271

摘要： 为解决船载全景视觉系统在视频采集过程中的图像晃动问题,提出了一种基于海天线的电子稳像算法。根据全景图像中海天线成像特点,提出了一种最优边缘估计算法计算海天线成像椭圆方程。建立了基于海天线的全景图像稳像模型,介绍了海天线稳像算法的实现,并给出了使用关键帧对稳像无效区域的重建方法。使用实际海洋环境下拍摄的海上全景图像序列进行了验证分析,实验结果表明:该算法对船载全景视觉系统采集的视频图像稳像快速、有效,平均计算时间小于50 ms,实际应用效果良好。

关键词: 计算机应用, 折反射全景视觉, 电子稳像, 海天线提取, 图像重建

Abstract: An electronic image stabilization algorithm based on sea-sky line was presented to solve the slosh problem in the video acquired from the on board catadioptric omnidirectional vision system. Combing with the characteristics of sea-sky line in omnidirectional image, a feasible method based on optimal edge estimation was proposed to get the sea-sky line elliptic equation. The omnidirectional image stabilization model is built based on sea-sky line. The application of the sea-sky line image stabilization algorithm is introduced and the method of reconstructing the invalidated regions using sky frame is given. The actual test was carried out using sequential panoramic images, which were obtained in marine environment. Experimental results show that the proposed algorithm is fast and effective to solve video image stabilization for on board catadioptric omnidirectional vision system. The average computation time is less than 50 ms/frame, which has good application effect.

Key words: computer application, catadioptric omnidirectional vision, electronic image stabilization, sea-sky line extraction, image reconstruction

中图分类号: 

  • TP391
[1] Mondragod I F, Pascual C, Caro M, et al. Omnidirectional vision applied to unmanned aerial vehicles(UAVs)attitude and heading estimation[J]. Robotics and Autonomous Systems, 2010, 58(6): 809-819.
[2] Mariottini G L, Scheggi S, Morbidi F, et al. An accurate and robust visual-compass algorithm for robot-mounted omnidirectional cameras[J]. Robotics and Autonomous Systems, 2012, 60(9): 1179-1190.
[3] 蔡成涛,梁小龙,谭吉来,等. 自适应最优块匹配视频稳像算法[J]. 系统工程与电子技术,2013,35(6):1324-1329. Cai Cheng-tao, Liang Xiao-long, Tan Ji-lai, et al. Adaptive optimal block matching video stabilization algorithm[J]. Systems Engineering and Electronics, 2013, 35(6): 1324-1329.
[4] 仲训昱,朱齐丹,张 智. 数字稳像中的快速和鲁棒运动估计研究[J]. 电子学报,2010,38(1):251-256. Zhong Xun-yu, Zhu Qi-dan, Zhang Zhi. Study of fast and robust motion estimation in the digital image stabilization[J]. Acta Electronica Sinica, 2010, 38(1): 251-256.
[5] 邵向鑫,郭树旭,王朗. 基于边缘扩展相位相关的图像拼接算法[J]. 吉林大学学报: 信息科学版,2010,28(1):95-99. Shao Xiang-xin, Guo Shu-xu, Wang Lang. Image mosaic algorithm based on extended phase correlation of edge[J]. Journal of Jilin University:Information Science Edition, 2010, 28(1): 95-99.
[6] 王洪,戴明. 区域快速鲁棒特征跟踪电子稳像[J]. 吉林大学学报: 工学版,2012,42(2):451-458. Wang Hong, Dai Ming.Area speed up robust feature tracking for electric image stablization[J]. Journal of Jilin University: Information Science Edition, 2012, 42(2): 451-458.
[7] 朱娟娟,郭宝龙. 电子稳像的特征点跟踪算法[J]. 光学学报,2006,26(4):516-521. Zhu Juan-juan, Guo Bao-long. Features tracking algorithm for video stabilization[J]. Acta Optica Sinica, 2006, 26(4) : 516-521.
[8] Zhao H, Wang T. Image stabilization algorithm based on multi-bitplane[C]∥Proc of the International Symposium on Photo-electronic Detection and Imaging, Beijing,2009:73842Z.
[9] Tian S, Wang N, Zhao P, et al. Aims at moving objects improvement based on gray projection of algorithm of the electronic image stabilization[C]∥Proc of the 3th International Congress on Image and Signal Processing, Yantai,2010: 2483-2487.
[10] 赵红颖,晏磊,熊经武. 船载摄像系统的一种电子稳像算法[J]. 光学技术,2003, 29(5):628-633. Zhao Hong-ying, Yan Lei, Xiong Jing-wu. A new electronic image stabilizing algorithm for the image sequence of camera system on board[J]. Optical Technique,2003, 29(5): 628-633.
[11] Xue Y T, Wu T. A new horizon electronic image stabilization algorithm based on SVM[C]∥2010 International Conference on Optoelectronics and Image Processing, Haiko 2010: 59-63.
[12] Matsushita Y, Ofek E, Ge W N, et al. Full-frame video stabilization with motion inpainting[J]. IEEE Trans Pattern Analysis and Machine Intelligence, 2006, 7(28): 1150-1163.
[13] 马子岭,王建中. 折反射全景侦察系统电子稳像技术研究[J]. 北京理工大学学报,2010,30(12):1475-1479. Ma Zi-ling, Wang Jian-zhong. Research on electronic image stabilizing algorithm of catadioptric panoramic reconnaissance system[J]. Transactions of Beijing Institute of Technology, 2010, 30(12):1475-1479.
[14] 朱齐丹,马宏业,左小祥. 全景摄像系统中展开图像的电子稳像方法研究[J]. 计算机应用研究,2009,26(3):1192-1194. Zhu Qi-dan, Ma Hong-ye, Zuo Xiao-xiang. Electronic image stabilizing method research for developing image in omnidirectional camera system[J]. Application Research of Computers, 2009, 26(3): 1192-1194.
[15] Baker S, Nayar S. A theory of catadioptric image formation[C]∥Sixth International Conference on Computer Vision, Bombay,1998: 35-42.
[16] Mei F, Yue G X, Yu Q C. The study on an application of otsu method in canny operator[C]∥Proceedings of the 2009 International Symposium on Information Processing, Huangshan,2009 : 109-112.
[17] 谭郁松,周兴铭. 保持连通的边缘细化算法[J]. 国防科技大学学报,2004,26(4):51-56. Tan Yu-song, Zhou Xing-ming. Connectivity preserved edge thinning algorithm[J]. Journal of National University of Defense Technology, 2004, 26(4): 51-56.
[1] 刘富,宗宇轩,康冰,张益萌,林彩霞,赵宏伟. 基于优化纹理特征的手背静脉识别系统[J]. 吉林大学学报(工学版), 2018, 48(6): 1844-1850.
[2] 王利民,刘洋,孙铭会,李美慧. 基于Markov blanket的无约束型K阶贝叶斯集成分类模型[J]. 吉林大学学报(工学版), 2018, 48(6): 1851-1858.
[3] 金顺福,王宝帅,郝闪闪,贾晓光,霍占强. 基于备用虚拟机同步休眠的云数据中心节能策略及性能[J]. 吉林大学学报(工学版), 2018, 48(6): 1859-1866.
[4] 赵东,孙明玉,朱金龙,于繁华,刘光洁,陈慧灵. 结合粒子群和单纯形的改进飞蛾优化算法[J]. 吉林大学学报(工学版), 2018, 48(6): 1867-1872.
[5] 刘恩泽,吴文福. 基于机器视觉的农作物表面多特征决策融合病变判断算法[J]. 吉林大学学报(工学版), 2018, 48(6): 1873-1878.
[6] 欧阳丹彤, 范琪. 子句级别语境感知的开放信息抽取方法[J]. 吉林大学学报(工学版), 2018, 48(5): 1563-1570.
[7] 刘富, 兰旭腾, 侯涛, 康冰, 刘云, 林彩霞. 基于优化k-mer频率的宏基因组聚类方法[J]. 吉林大学学报(工学版), 2018, 48(5): 1593-1599.
[8] 桂春, 黄旺星. 基于改进的标签传播算法的网络聚类方法[J]. 吉林大学学报(工学版), 2018, 48(5): 1600-1605.
[9] 刘元宁, 刘帅, 朱晓冬, 陈一浩, 郑少阁, 沈椿壮. 基于高斯拉普拉斯算子与自适应优化伽柏滤波的虹膜识别[J]. 吉林大学学报(工学版), 2018, 48(5): 1606-1613.
[10] 车翔玖, 王利, 郭晓新. 基于多尺度特征融合的边界检测算法[J]. 吉林大学学报(工学版), 2018, 48(5): 1621-1628.
[11] 赵宏伟, 刘宇琦, 董立岩, 王玉, 刘陪. 智能交通混合动态路径优化算法[J]. 吉林大学学报(工学版), 2018, 48(4): 1214-1223.
[12] 黄辉, 冯西安, 魏燕, 许驰, 陈慧灵. 基于增强核极限学习机的专业选择智能系统[J]. 吉林大学学报(工学版), 2018, 48(4): 1224-1230.
[13] 傅文博, 张杰, 陈永乐. 物联网环境下抵抗路由欺骗攻击的网络拓扑发现算法[J]. 吉林大学学报(工学版), 2018, 48(4): 1231-1236.
[14] 曹洁, 苏哲, 李晓旭. 基于Corr-LDA模型的图像标注方法[J]. 吉林大学学报(工学版), 2018, 48(4): 1237-1243.
[15] 侯永宏, 王利伟, 邢家明. 基于HTTP的动态自适应流媒体传输算法[J]. 吉林大学学报(工学版), 2018, 48(4): 1244-1253.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
版权所有 © 《吉林大学学报(工学版)》编辑部
地址：长春市人民大街5988号　电话：+86-431-85095297　传真：+86-431-85094074　E-mail: xbgxb@jlu.edu.cn
本系统由北京玛格泰克科技发展有限公司设计开发