吉林大学学报(工学版) ›› 2018, Vol. 48 ›› Issue (3): 909-918.doi: 10.13229/j.cnki.jdxbgxb20170146

• Orginal Article • Previous Articles     Next Articles

Real-time surface reconstruction based global camera pose optimization

LIN Jin-hua1, WANG Yan-jie2, WANG Lu1, YAO Yu3   

  1. 1.School of Application Technology, Changchun University of Technology, Changchun 130012,China;
    2. Chinese Academy of Sciences, Changchun Institute of Optics, Fine Mechanics and Physics,Changchun 130033, China;
    3.College of Mechanical Science and Engineering, Jilin University, Changchun 130012,China
  • Received:2017-02-23 Online:2018-05-20 Published:2018-05-20

RICH HTML

0   

PDF (PC)

333

Abstract: An end-to-end online large-scale 3D scene reconstruction method is proposed. This method uses robustness to estimate the rotation attitude of the camera and constructs a hierarchical optimization framework for the fusion of depth data input. Then, the information of each frame is optimized according to the global pose of the camera, and the algorithm limits the target tracking time and completes real-time tracking of the frame. Experimental results show that the average time to reconstruct the algorithm reaches 399 ms and the average number of estimated Iterative Closest Point (ICP) times is 20, which needs 100 ms to complete each frame transformation. The system is robust to the reconstruction of large-scale scenes and has better real-time performance. This method is a real-time three-dimensional reconstruction system with corresponding sparseness, dense structure information and camera illustration uniformity.

Key words: computer application, machine vision, 3D reconstruction, online volume fusion, pose estimation

CLC Number: 

  • TP391
[1] Weise T, Wismer T, Leibe B, et al.In-hand scanning with online loop closure[C]∥IEEE International Conference on Computer Vision Workshops,Kyoto,Japan,2009:1630-1637.
[2] Henry P,Krainin M,Herbst E,et al.RGB-D mapping: using depth cameras for dense 3D modeling of indoor environments[J]. International Journal of Robotics Research,2012,31(5):647-663.
[3] Keller M, Lefloch D, Lambers M, et al.Real-time 3D reconstruction in dynamic scenes using point-based fusion[C]∥International Conference on 3D Vision-3DV,Tokyo,Japan,2013,8768(2):1-8.
[4] Whelan T,Leutenegger S,Salas-moreno R F,et al. Elastic fusion: dense SLAM without a pose graph[J/OL].[2017-02-10]. http://www.doc.ic.ac.uk/~bglocker/pdfs/whelan2015rss.pdf.
[5] Merrell P,Akbarzadeh A,Wang L,et al.Real-time visibility based fusion of depth maps[C]∥IEEE International Conference on Computer Vision, Rio de Janeiro, Brazil,2007:1-8.
[6] Meilland M, Comport A.On unifying key-frame and voxel-based dense visual SLAM at large scales[C]∥International Conference on Intelligent Robots & Systems, Tokyo, Japan,2013:3677-3683.
[7] Gallup D, Pollefeys M, Frahm J M.3D reconstruction using an n-layer heightmap[J]. Pattern Recognition,2010,6376:1-10.
[8] Wurm K M,Hornung A,Bennewitz M,et al. Octomap:a probabilistic, flexible, and compact 3D map representation for robotic systems[J/OL].[2017-02-13]. http://ais.informatik.uni-freiburg.de/publications/papers/wurm10octomap.pdf.
[9] Curless B,Levoy M.A volumetric method for building complex models from range images[C]∥Conference on Computer Graphics and Interactive Techniques,New Orleans,LA,USA,1996:303-312.
[10] Kornuta T, Laszkowski M.Perception subsystem for object recognition and pose estimation in RGB-D images[J]. Automation, Springer International Publishing,2016,44(10):995-1003.
[11] Steinbruecker F,Sturm J,Cremers D.Volumetric 3D mapping in real-time on a CPU[C]∥IEEE International Conference on Robotics and Automation,Stockholm,Sweden,2014:2021-2028.
[12] Zollhöfer M,Thies J,Colaianni M,et al.Interactive model-based reconstruction of the human head using an RGB-D sensor[J]. Computer Animation & Virtual Worlds,2014,25(3-4):213-222.
[13] Zhou Q Y. Koltun V.Color map optimization for 3D reconstruction with consumer depth cameras[J]. ACM Transactions on Graphics,2014,33(4):1-10.
[14] Choi S,Zhou Q Y,Koltun V.Robust reconstruction of indoor scenes[C]∥IEEE Conference on Computer Vision and Pattern Recognition (CVPR),Boston,MA,USA,2015:5556-5565.
[15] Wikowski A,Kornuta T,Stefańczyk M,et al.Efficient generation of 3D surfel maps using RGB-D sensors[J]. International Journal of Applied Mathematics & Computer Science,2016,26(1):99-122.
[16] Newcombe R A, Izadi S, Hilliges O,et al.KinectFusion: real-time dense surface mapping and tracking[C]∥Conference on Computer Graphics & Interactive Techniques,New Orleans,LA,USA,1996:303-312.
[17] Whelan T,Johannsson H,Kaess M,et al.Robust real-time visual odometry for dense RGB-D mapping[C]∥IEEE International Conference on Robotics and Automation, Karlsruhe,Germany,2013:13851317.
[18] Lin J H, Wang Y J, Sun H H.A Feature-adaptive subdivision method for real-time 3D reconstruction of repeated topology surfaces[J]. 3D Research,2017,8(1):1-16.
[19] 王新华,欧阳继红,张广,等. 微扫描红外成像超分辨重建[J]. 吉林大学学报:工学版,2017,47(1):235-241.
Wang Xin-hua,Ouyang Ji-hong,Zhang Guang, et al.Super-resolution reconstruction of infrared images based on micro-scanner[J]. Journal of Jilin University(Engineering and Technology Edition),2017,47(1):235-241.
[20] 刘迎,王朝阳,高楠,等. 特征提取的点云自适应精简[J]. 光学精密工程, 2017,25(1):245-254.
Liu Ying,Wang Chao-yang,Gao Nan, et al.Point cloud adaptive simplification of feature extraction[J]. Optics and Precision Engineering,2017,25(1):245-254.
[21] 张雷,王延杰,孙宏海,等. 采用核相关滤波器的自适应尺度目标跟踪[J]. 光学精密工程,2016,24(2):448-459.
Zhang Lei,Wang Yan-jie,Sun Hong-hai,et al.Adaptive scale object tracking with kernelized correlation filters[J]. Optics and Precision Engineering,2016,24(2):448-459.
[22] 王慧利,朱明,蔺春波,等. 光学遥感图像中复杂海背景下的舰船检测[J]. 光学精密工程,2018,26(3):723-732.
Wang Hui-li,Zhu Ming,Lin Chun-bo,et al.Ship detection of complex sea background in optical remote sensing images[J]. Optics and Precision Engineering, 2018,26(3):723-732.
[23] 李湘眷,王彩玲,李宇,等.窗口融合特征对比度的光学遥感目标检测[J].光学精密工程,2016,24(8):2067-2077.
Li Xiang-juan,Wang Cai-ling,Li Yu,et al.Optical remote Sensing object detection based on fused feature Contrast of subwindows[J]. Optics and Precision Engineering,2016,24(8): 2067-2077.
[24] 徐伟,陈彦彤,朴永杰,等.基于吉林一号遥感图像的星载目标快速识别系统[J].光学精密工程,2017,25(1):255-262.
Xu Wei,Chen Yan-tong,Piao Yong-jie,et al.Target fast matching recognition of on-board system based on Jilin-1 satellite image[J]. Optics and Precision Engineering,2017,25(1):255-262.
[1] LIU Fu,ZONG Yu-xuan,KANG Bing,ZHANG Yi-meng,LIN Cai-xia,ZHAO Hong-wei. Dorsal hand vein recognition system based on optimized texture features [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1844-1850.
[2] WANG Li-min,LIU Yang,SUN Ming-hui,LI Mei-hui. Ensemble of unrestricted K-dependence Bayesian classifiers based on Markov blanket [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1851-1858.
[3] JIN Shun-fu,WANG Bao-shuai,HAO Shan-shan,JIA Xiao-guang,HUO Zhan-qiang. Synchronous sleeping based energy saving strategy of reservation virtual machines in cloud data centers and its performance research [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1859-1866.
[4] ZHAO Dong,SUN Ming-yu,ZHU Jin-long,YU Fan-hua,LIU Guang-jie,CHEN Hui-ling. Improved moth-flame optimization method based on combination of particle swarm optimization and simplex method [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1867-1872.
[5] LIU En-ze,WU Wen-fu. Agricultural surface multiple feature decision fusion disease judgment algorithm based on machine vision [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1873-1878.
[6] OUYANG Dan-tong, FAN Qi. Clause-level context-aware open information extraction [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(5): 1563-1570.
[7] LIU Fu, LAN Xu-teng, HOU Tao, KANG Bing, LIU Yun, LIN Cai-xia. Metagenomic clustering method based on k-mer frequency optimization [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(5): 1593-1599.
[8] GUI Chun, HUANG Wang-xing. Network clustering method based on improved label propagation algorithm [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(5): 1600-1605.
[9] LIU Yuan-ning, LIU Shuai, ZHU Xiao-dong, CHEN Yi-hao, ZHENG Shao-ge, SHEN Chun-zhuang. LOG operator and adaptive optimization Gabor filtering for iris recognition [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(5): 1606-1613.
[10] CHE Xiang-jiu, WANG Li, GUO Xiao-xin. Improved boundary detection based on multi-scale cues fusion [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(5): 1621-1628.
[11] ZHAO Hong-wei, LIU Yu-qi, DONG Li-yan, WANG Yu, LIU Pei. Dynamic route optimization algorithm based on hybrid in ITS [J]. 吉林大学学报(工学版), 2018, 48(4): 1214-1223.
[12] HUANG Hui, FENG Xi-an, WEI Yan, XU Chi, CHEN Hui-ling. An intelligent system based on enhanced kernel extreme learning machine for choosing the second major [J]. 吉林大学学报(工学版), 2018, 48(4): 1224-1230.
[13] FU Wen-bo, ZHANG Jie, CHEN Yong-le. Network topology discovery algorithm against routing spoofing attack in Internet of things [J]. 吉林大学学报(工学版), 2018, 48(4): 1231-1236.
[14] CAO Jie, SU Zhe, LI Xiao-xu. Image annotation method based on Corr-LDA model [J]. 吉林大学学报(工学版), 2018, 48(4): 1237-1243.
[15] HOU Yong-hong, WANG Li-wei, XING Jia-ming. HTTP-based dynamic adaptive streaming video transmission algorithm [J]. 吉林大学学报(工学版), 2018, 48(4): 1244-1253.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
[1] LIU Song-shan, WANG Qing-nian, WANG Wei-hua, LIN Xin. Influence of inertial mass on damping and amplitude-frequency characteristic of regenerative suspension[J]. 吉林大学学报(工学版), 2013, 43(03): 557 -563 .
[2] CHU Liang, WANG Yan-bo, QI Fu-wei, ZHANG Yong-sheng. Control method of inlet valves for brake pressure fine regulation[J]. 吉林大学学报(工学版), 2013, 43(03): 564 -570 .
[3] LI Jing, WANG Zi-han, YU Chun-xian, HAN Zuo-yue, SUN Bo-hua. Design of control system to follow vehicle state with HIL test beach[J]. 吉林大学学报(工学版), 2013, 43(03): 577 -583 .
[4] ZHU Jian-feng, LIN Yi, CHEN Xiao-kai, SHI Guo-biao. Structural topology optimization based design of automotive transmission housing structure[J]. 吉林大学学报(工学版), 2013, 43(03): 584 -589 .
[5] HU Xing-jun, LI Teng-fei, WANG Jing-yu, YANG Bo, GUO Peng, LIAO Lei. Numerical simulation of the influence of rear-end panels on the wake flow field of a heavy-duty truck[J]. 吉林大学学报(工学版), 2013, 43(03): 595 -601 .
[6] WANG Tong-jian, CHEN Jin-shi, ZHAO Feng, ZHAO Qing-bo, LIU Xin-hui, YUAN Hua-shan. Mechanical-hydraulic co-simulation and experiment of full hydraulic steering systems[J]. 吉林大学学报(工学版), 2013, 43(03): 607 -612 .
[7] ZHANG Chun-qin, JIANG Gui-yan, WU Zheng-yan. Factors influencing motor vehicle travel departure time choice behavior[J]. 吉林大学学报(工学版), 2013, 43(03): 626 -632 .
[8] MA Wan-jing, XIE Han-zhou. Integrated control of main-signal and pre-signal on approach of intersection with double stop line[J]. 吉林大学学报(工学版), 2013, 43(03): 633 -639 .
[9] YU De-xin, TONG Qian, YANG Zhao-sheng, GAO Peng. Forecast model of emergency traffic evacuation time under major disaster[J]. 吉林大学学报(工学版), 2013, 43(03): 654 -658 .
[10] XIAO Yun, LEI Jun-qing, ZHANG Kun, LI Zhong-san. Fatigue stiffness degradation of prestressed concrete beam under multilevel amplitude cycle loading[J]. 吉林大学学报(工学版), 2013, 43(03): 665 -670 .
Copyright © Journal of Jilin University(Engineering and Technology Edition), All Rights Reserved.
Tel: +86-431-85095297　Fax: +86-431-85094074　E-mail: xbgxb@jlu.edu.cn
Powered by Beijing Magtech Co. Ltd