吉林大学学报(工学版) ›› 2016, Vol. 46 ›› Issue (6): 2116-2122.doi: 10.13229/j.cnki.jdxbgxb201606048

Previous Articles     Next Articles

Video stabilization based on background feature points

JI Shu-jiao1, LEI Yan-min1, ZHU Ming2   

  1. 1.College of Electronic Information and Engineering, Changchun University, Changchun 130022,China;
    2.Changchun Institute of Optics, Fine Mechanics and Physics, University of Chinese Academy of Sciences, Changchun 130033,China
  • Received:2015-06-01 Online:2016-11-20 Published:2016-11-20

PDF (PC)

255

Abstract: The objective of this paper is to stabilize electronic image for aerial video with dynamic background. When shooting, as the camera follows the target, the video sequence changes scenarios. This is due to the movement of the camera and the change of background, so the scene is complicated. The difficulties in stabilizing video image with dynamic background include: an accurate estimate motion vector of camera movement and background compensation. To overcome such difficulties, this paper uses KLT track operator in combination with the M-estimator Sample and Consensus (MSAC) algorithm to realize feature point classification. Then, only the feature points on the background are used for global motion estimation to perform image stabilization. Experimental results demonstrate the feasibility of the proposed method.

Key words: information processing technology, electronic image stabilization, background characteristics, motion compensation

CLC Number: 

  • TN941.1
[1] 吉淑娇,朱明,胡汉平. 基于特征点匹配的电子稳像算法综述[J].中国光学,2013,6(6):841-849.
Ji Shu-jiao, Zhu Ming, Hu Han-ping. Aero-borne electronic image stabilization based on feature point matching[J].Chinese Optics,2013, 6(6): 841-849.
[2] Ryu Y G, Chung M J. Robust online digital image stabilization based on point-feature trajectory without accumulative global motion estimation[J]. IEEE Signal Processing Letters, 2012,19(4):223-226.
[3] 吉淑娇,朱明,雷艳敏,等.基于改进运动矢量估计法的视频稳像[J]. 光学精密工程,2015,23(5):254-261.
Ji Shu-jiao, Zhu Ming, Lei Yan-min.et al. Video stabilization with improved motion vector estimation[J].Opt Precision Eng, 2015,23(5):254-261.
[4] Kim S K, Kang S J, Wang T S, et al. Feature point classification based global motion estimation for video stabilization[J]. IEEE Transactions on Consumer Electronics, 2013(3):267-272.
[5] 朱齐丹,徐从营,蔡成涛. 船载这反射全景试卷系统电子稳像算法[J].吉林大学学报:工学版,2015,45(4):1288-1296.
Zhu Qi-dan,Xu Cong-ying, Cai Cheng-tao. Electronic image stabilization algorithm for on board catadioptric omnidirectional vision system[J].Journal of Jilin University(Engineering and Technology Edition), 2015,45(4):1288-1296.
[6] Choi K S, Lee J S, Kim J W, et a1.An efficient digital image stabilizing technique for mobile video ommunications[C]∥International Conference on Consumer Electronics,Berlin,2000:246-247.
[7] 吉淑娇.基于特征匹配的机载电子稳像技术研究[D].长春:中国科学院大学长春光学精密机械与物理研究所,2015.
Ji Shu-Jiao.Airborne electronic image stabilization technology based on feature points[D].Changchun:Changchun Institute of Optics, Fine Mechanics and Physics, University of Chinese Academy of Sciences,2015.
[8] Torr P, Murray D. The development and comparison of robust methods for estimating the fundamental matrix[J]. International Journal of Computer Vision,1997, 24(3): 271-300.
[9] Torr P H S, Zisserman A. Robust computation and parametrization of multiple view relations[C]∥International Conference of Computer Vision,Bombay,1998:727-732.
[10] Torr P H S, Zisserman A. MLESAC: a new robust estimator with application to estimating image geometry[J].Computer Vision and Image Understanding,2000, 78(1): 138-156.
[11] Wang H, Gregory D M, Hager D. A generalized kernel consensus based robust estimator[J].IEEE Transactions on Analysis and Machine Intelligence, 2010,32(1):178-184.
[12] Subbarao R, Meer P. Beyond RANSAC: user independent robust regression[C]∥Conference on Computer Vision and Pattern Recognition Workshop, New York,2006:101-108.
[13] Ji Shu-jiao,Zhu Ming,Lei Yan-min. Video stabilization algorithm based on background feature points matching[C]∥International Conference on Sensors Measurement and Intelligent Materials,Shanghai,China,2015: 690-693.
[14] 严洁, 阮友田, 薛珮瑶. 主被动光学图像融合技术研究[J]. 中国光学, 2015,8(3): 378-385.
Yan Jie, Ruan You-tian, Xue Pei-yao. Active and passive optical image fusion technology[J]. Chinese Optics, 2015,8(3): 378-385.
[15] 孙寿健, 魏立线, 刘佳, 等. 一种基于权重融合的JPEG隐写分析方法[J]. 液晶与显示, 2015, 30(2): 326-332.
Sun Shou-jian, Wei Li-xian, Liu Jia, et al. A rights-based re-integration method for JPEG steganalysis[J]. Chinese Journal of Liquid Crystal and Displays, 2015, 30(2): 326-332.
[16] 朴永杰, 徐伟, 王绍举,等. 高动态范围视频的多曝光图像序列快速融合[J]. 液晶与显示, 2014, 29(6):1032-1041.
Piao Yong-jie, Xu Wei, Wang Shao-ju, et al. Fast multi-exposure image fusion for HDR video[J]. Chinese Journal of Liquid Crystal and Displays, 2014, 29(6):1032-1041.
[17] 柯洪昌, 孙宏彬,. 图像序列的显著性目标区域检测方法[J]. 中国光学, 2015,8(5): 768-774.
Ke Hong-chang, Sun Hong-bin. A saliency target area detection method of image sequence[J]. Chinese Optics, 2015,8(5): 768-774.
[1] YING Huan,LIU Song-hua,TANG Bo-wen,HAN Li-fang,ZHOU Liang. Efficient deterministic replay technique based on adaptive release strategy [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1917-1924.
[2] LIU Zhong-min,WANG Yang,LI Zhan-ming,HU Wen-jin. Image segmentation algorithm based on SLIC and fast nearest neighbor region merging [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1931-1937.
[3] SHAN Ze-biao,LIU Xiao-song,SHI Hong-wei,WANG Chun-yang,SHI Yao-wu. DOA tracking algorithm using dynamic compressed sensing [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1938-1944.
[4] YAO Hai-yang, WANG Hai-yan, ZHANG Zhi-chen, SHEN Xiao-hong. Reverse-joint signal detection model with double Duffing oscillator [J]. 吉林大学学报(工学版), 2018, 48(4): 1282-1290.
[5] QUAN Wei, HAO Xiao-ming, SUN Ya-dong, BAI Bao-hua, WANG Yu-ting. Development of individual objective lens for head-mounted projective display based on optical system of actual human eye [J]. 吉林大学学报(工学版), 2018, 48(4): 1291-1297.
[6] CHEN Mian-shu, SU Yue, SANG Ai-jun, LI Pei-peng. Image classification methods based on space vector model [J]. 吉林大学学报(工学版), 2018, 48(3): 943-951.
[7] CHEN Tao, CUI Yue-han, GUO Li-min. Improved algorithm of multiple signal classification for single snapshot [J]. 吉林大学学报(工学版), 2018, 48(3): 952-956.
[8] MENG Guang-wei, LI Rong-jia, WANG Xin, ZHOU Li-ming, GU Shuai. Analysis of intensity factors of interface crack in piezoelectric bimaterials [J]. 吉林大学学报(工学版), 2018, 48(2): 500-506.
[9] LIN Jin-hua, WANG Yan-jie, SUN Hong-hai. Improved feature-adaptive subdivision for Catmull-Clark surface model [J]. 吉林大学学报(工学版), 2018, 48(2): 625-632.
[10] WANG Ke, LIU Fu, KANG Bing, HUO Tong-tong, ZHOU Qiu-zhan. Bionic hypocenter localization method inspired by sand scorpion in locating preys [J]. 吉林大学学报(工学版), 2018, 48(2): 633-639.
[11] YU Hua-nan, DU Yao, GUO Shu-xu. High-precision synchronous phasor measurement based on compressed sensing [J]. 吉林大学学报(工学版), 2018, 48(1): 312-318.
[12] WANG Fang-shi, WANG Jian, LI Bing, WANG Bo. Deep attribute learning based traffic sign detection [J]. 吉林大学学报(工学版), 2018, 48(1): 319-329.
[13] LIU Dong-liang, WANG Qiu-shuang. Instantaneous velocity extraction method on NGSLM data [J]. 吉林大学学报(工学版), 2018, 48(1): 330-335.
[14] TANG Kun, SHI Rong-hua. Detection of wireless sensor network failure area based on butterfly effect signal [J]. 吉林大学学报(工学版), 2017, 47(6): 1939-1948.
[15] LI Juan, MENG Ke-xin, LI Yue, LIU Hui-li. Seismic signal noise suppression based on similarity matched Wiener filtering [J]. 吉林大学学报(工学版), 2017, 47(6): 1964-1968.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
[1] LIU Song-shan, WANG Qing-nian, WANG Wei-hua, LIN Xin. Influence of inertial mass on damping and amplitude-frequency characteristic of regenerative suspension[J]. 吉林大学学报(工学版), 2013, 43(03): 557 -563 .
[2] CHU Liang, WANG Yan-bo, QI Fu-wei, ZHANG Yong-sheng. Control method of inlet valves for brake pressure fine regulation[J]. 吉林大学学报(工学版), 2013, 43(03): 564 -570 .
[3] LI Jing, WANG Zi-han, YU Chun-xian, HAN Zuo-yue, SUN Bo-hua. Design of control system to follow vehicle state with HIL test beach[J]. 吉林大学学报(工学版), 2013, 43(03): 577 -583 .
[4] HU Xing-jun, LI Teng-fei, WANG Jing-yu, YANG Bo, GUO Peng, LIAO Lei. Numerical simulation of the influence of rear-end panels on the wake flow field of a heavy-duty truck[J]. 吉林大学学报(工学版), 2013, 43(03): 595 -601 .
[5] WANG Tong-jian, CHEN Jin-shi, ZHAO Feng, ZHAO Qing-bo, LIU Xin-hui, YUAN Hua-shan. Mechanical-hydraulic co-simulation and experiment of full hydraulic steering systems[J]. 吉林大学学报(工学版), 2013, 43(03): 607 -612 .
[6] ZHANG Chun-qin, JIANG Gui-yan, WU Zheng-yan. Factors influencing motor vehicle travel departure time choice behavior[J]. 吉林大学学报(工学版), 2013, 43(03): 626 -632 .
[7] MA Wan-jing, XIE Han-zhou. Integrated control of main-signal and pre-signal on approach of intersection with double stop line[J]. 吉林大学学报(工学版), 2013, 43(03): 633 -639 .
[8] YU De-xin, TONG Qian, YANG Zhao-sheng, GAO Peng. Forecast model of emergency traffic evacuation time under major disaster[J]. 吉林大学学报(工学版), 2013, 43(03): 654 -658 .
[9] WANG Guo-lin, FU Nai-ji, ZHANG Jian, PEI Zi-rong. Simulation of the radial tire curing process based on K-R kinetic model[J]. 吉林大学学报(工学版), 2013, 43(03): 659 -664 .
[10] XIAO Yun, LEI Jun-qing, ZHANG Kun, LI Zhong-san. Fatigue stiffness degradation of prestressed concrete beam under multilevel amplitude cycle loading[J]. 吉林大学学报(工学版), 2013, 43(03): 665 -670 .
Copyright © Journal of Jilin University(Engineering and Technology Edition), All Rights Reserved.
Tel: +86-431-85095297　Fax: +86-431-85094074　E-mail: xbgxb@jlu.edu.cn
Powered by Beijing Magtech Co. Ltd