吉林大学学报(工学版) ›› 2016, Vol. 46 ›› Issue (5): 1697-1703.doi: 10.13229/j.cnki.jdxbgxb201605046

Previous Articles     Next Articles

Depth map inpainting method based on Kinect sensor

LYU Chao-hui, SHEN Ying-hua, LI Jing-hua   

  1. School of Information Engineering, Communication University of China, Beijing 100024, China
  • Received:2015-04-15 Online:2016-09-20 Published:2016-09-20

Abstract: A method is proposed to inpaint depth map, which combines the Weight Joint Bilateral Filter (WJBF) with Depth Compensation Filter (DCF). First, the color image and the depth map are aligned, and then the holes and noises of the depth map are filtered using WJBF. Finally, the blurs of edges are reduced using DCF. The proposed method is compared with three common depth map enhancement methods from qualitative and quantitative analyses. Experimental results show that the proposed method can achieve better performance.

Key words: information processing technology, depth map, weight joint bilateral filter (WJBF), depth compensation filter (DCF)

CLC Number: 

  • TN919.8
[1] Benavidez P, Jamshidi M. Mobile robot navigation and target tracking system[C]∥6th International Conference on System of Systems Engineering, New Mexico, IEEE, 2011: 299-304.
[2] Izadi S, Kim D, Hilliges O, et al. KinceFusion: real-time 3D reconstruction and interaction using a moving depth camera[C]∥Symposium on User Interface Software and Technology, Santa Barbar, ACM, 2011: 559-568.
[3] 赵岩,汪敬媛,陈贺新,等. 基于深度图像和半像素的虚拟视点绘制[J].吉林大学学报:工学版,2013,43(增刊):256-259.
Zhao Yan, Wang Jing-yuan, Chen He-xin,et al. Virtual view rendering based on depth image and half pixel precision[J]. Journal of Jilin University (Engineering and Technology Edition), 2013,43(Sup.):256-259.
[4] 胡汉平,朱明. 基于种子点传播的快速立体匹配[J]. 光学精密工程,2015,23(3):887-894.
Hu Han-ping,Zhu Ming.Fast stereo matching based on seed pixel propagation[J]. Optics and Precision Engineering, 2015,23(3):887-894.
[5] He K, Sun J,Tang X. Guided image filtering[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(6):1397-1409.
[6] Liu Jin-yi, Gong Xiao-jin, Liu Ji-lin. Guided inpainting and filtering for Kinect depth maps[C]∥International Conference on Pattern Recognition, Tsukuba, IEEE, 2012: 2055-2058.
[7] Liu S, Wang Y, Wang J,et al. Kinect depth restoration via energy minimization with TV21 regularization[C]∥International Conference on Image Processing, Melbouene, IEEE, 2013:724-727.
[8] Yang Na-eun, Kim Yong-gou, Park Rae-hong. Depth hole filling using the depth distribution of neighboring regions of depth holes in the Kinect sensor[C]∥Signal Processing, Communication and Computing,Hong Kong, IEEE,2010:658-661.
[9] 康佳伦,唐向宏.一种基于FMM带方向图像修复算法[J]. 杭州电子科技大学学报,2012, 32(5):147-150.
Kang Jia-lun, Tang Xiang-hong. A direction image inpainting algorithm based on fast marching method[J]. Journal of Hangzhou Dianzi University, 2012, 32(5):147-150.
[10] Telea A. An image inpainting technique based on the fast marching method[J].Journal of Graphics Tools, 2004, 9(1):25-36.
[11] Janoch A, Karayev S, Jia Y, et al. A category-level 3-D object dataset:putting the Kinect to work[C]∥International Conference on Computer Vision Workshops, Barcelona, IEEE, 2011:1168-1174.
[12] Camplani M, Salgado L. Efficient spatio-temporal hole filling strategy for Kinect depth maps[C]∥Three-Dimensional Image Processing and Applications II, Burlingame, SPIE, 2012: 82900E.
[1] YING Huan,LIU Song-hua,TANG Bo-wen,HAN Li-fang,ZHOU Liang. Efficient deterministic replay technique based on adaptive release strategy [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1917-1924.
[2] LIU Zhong-min,WANG Yang,LI Zhan-ming,HU Wen-jin. Image segmentation algorithm based on SLIC and fast nearest neighbor region merging [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1931-1937.
[3] SHAN Ze-biao,LIU Xiao-song,SHI Hong-wei,WANG Chun-yang,SHI Yao-wu. DOA tracking algorithm using dynamic compressed sensing [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1938-1944.
[4] YAO Hai-yang, WANG Hai-yan, ZHANG Zhi-chen, SHEN Xiao-hong. Reverse-joint signal detection model with double Duffing oscillator [J]. 吉林大学学报(工学版), 2018, 48(4): 1282-1290.
[5] QUAN Wei, HAO Xiao-ming, SUN Ya-dong, BAI Bao-hua, WANG Yu-ting. Development of individual objective lens for head-mounted projective display based on optical system of actual human eye [J]. 吉林大学学报(工学版), 2018, 48(4): 1291-1297.
[6] CHEN Mian-shu, SU Yue, SANG Ai-jun, LI Pei-peng. Image classification methods based on space vector model [J]. 吉林大学学报(工学版), 2018, 48(3): 943-951.
[7] CHEN Tao, CUI Yue-han, GUO Li-min. Improved algorithm of multiple signal classification for single snapshot [J]. 吉林大学学报(工学版), 2018, 48(3): 952-956.
[8] MENG Guang-wei, LI Rong-jia, WANG Xin, ZHOU Li-ming, GU Shuai. Analysis of intensity factors of interface crack in piezoelectric bimaterials [J]. 吉林大学学报(工学版), 2018, 48(2): 500-506.
[9] LIN Jin-hua, WANG Yan-jie, SUN Hong-hai. Improved feature-adaptive subdivision for Catmull-Clark surface model [J]. 吉林大学学报(工学版), 2018, 48(2): 625-632.
[10] WANG Ke, LIU Fu, KANG Bing, HUO Tong-tong, ZHOU Qiu-zhan. Bionic hypocenter localization method inspired by sand scorpion in locating preys [J]. 吉林大学学报(工学版), 2018, 48(2): 633-639.
[11] YU Hua-nan, DU Yao, GUO Shu-xu. High-precision synchronous phasor measurement based on compressed sensing [J]. 吉林大学学报(工学版), 2018, 48(1): 312-318.
[12] WANG Fang-shi, WANG Jian, LI Bing, WANG Bo. Deep attribute learning based traffic sign detection [J]. 吉林大学学报(工学版), 2018, 48(1): 319-329.
[13] LIU Dong-liang, WANG Qiu-shuang. Instantaneous velocity extraction method on NGSLM data [J]. 吉林大学学报(工学版), 2018, 48(1): 330-335.
[14] TANG Kun, SHI Rong-hua. Detection of wireless sensor network failure area based on butterfly effect signal [J]. 吉林大学学报(工学版), 2017, 47(6): 1939-1948.
[15] LI Juan, MENG Ke-xin, LI Yue, LIU Hui-li. Seismic signal noise suppression based on similarity matched Wiener filtering [J]. 吉林大学学报(工学版), 2017, 47(6): 1964-1968.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] LIU Song-shan, WANG Qing-nian, WANG Wei-hua, LIN Xin. Influence of inertial mass on damping and amplitude-frequency characteristic of regenerative suspension[J]. 吉林大学学报(工学版), 2013, 43(03): 557 -563 .
[2] CHU Liang, WANG Yan-bo, QI Fu-wei, ZHANG Yong-sheng. Control method of inlet valves for brake pressure fine regulation[J]. 吉林大学学报(工学版), 2013, 43(03): 564 -570 .
[3] LI Jing, WANG Zi-han, YU Chun-xian, HAN Zuo-yue, SUN Bo-hua. Design of control system to follow vehicle state with HIL test beach[J]. 吉林大学学报(工学版), 2013, 43(03): 577 -583 .
[4] HU Xing-jun, LI Teng-fei, WANG Jing-yu, YANG Bo, GUO Peng, LIAO Lei. Numerical simulation of the influence of rear-end panels on the wake flow field of a heavy-duty truck[J]. 吉林大学学报(工学版), 2013, 43(03): 595 -601 .
[5] WANG Tong-jian, CHEN Jin-shi, ZHAO Feng, ZHAO Qing-bo, LIU Xin-hui, YUAN Hua-shan. Mechanical-hydraulic co-simulation and experiment of full hydraulic steering systems[J]. 吉林大学学报(工学版), 2013, 43(03): 607 -612 .
[6] ZHANG Chun-qin, JIANG Gui-yan, WU Zheng-yan. Factors influencing motor vehicle travel departure time choice behavior[J]. 吉林大学学报(工学版), 2013, 43(03): 626 -632 .
[7] MA Wan-jing, XIE Han-zhou. Integrated control of main-signal and pre-signal on approach of intersection with double stop line[J]. 吉林大学学报(工学版), 2013, 43(03): 633 -639 .
[8] YU De-xin, TONG Qian, YANG Zhao-sheng, GAO Peng. Forecast model of emergency traffic evacuation time under major disaster[J]. 吉林大学学报(工学版), 2013, 43(03): 654 -658 .
[9] XIAO Yun, LEI Jun-qing, ZHANG Kun, LI Zhong-san. Fatigue stiffness degradation of prestressed concrete beam under multilevel amplitude cycle loading[J]. 吉林大学学报(工学版), 2013, 43(03): 665 -670 .
[10] XIAO Rui, DENG Zong-cai, LAN Ming-zhang, SHEN Chen-liang. Experiment research on proportions of reactive powder concrete without silica fume[J]. 吉林大学学报(工学版), 2013, 43(03): 671 -676 .