吉林大学学报(工学版) ›› 2013, Vol. 43 ›› Issue (增刊1): 256-259.

Previous Articles     Next Articles

Virtual view rendering based on depth image and half pixel precision

ZHAO Yan, WANG Jing-yuan, CHEN He-xin, LIU Jing, WANG Ke-wei   

  1. College of Communication Engineering, Jilin University, Changchun 130012, China
  • Received:2012-06-15 Published:2013-06-01

Abstract:

In order to improve the rendering accuracy,an algorithm based on depth image and half pixel precision was proposed.Firstly the reference images were preprocessed,including the half-pixel processing and brightness correction,then forward 3D image warping is utilized to generate the image and depth map of the virtual view,inverse 3D image warping was used to fill part of holes caused by some factors,such as inaccurate depth information,and then ghosting was erased according to depth comparison,finally different methods was used to fill the remaining holes according to the types of the holes.The experimental results show that the proposed method can obtain satisfactory rendering results.

Key words: depth image based rendering, half pixel precision, 3D image warping, hole filling

CLC Number: 

  • TN919.8

[1] Tanimoto M.Overview of free viewpoint television [J].Signal Processing Image Communication,2006,21(6):454-461.

[2] Feng Ya-mei,Li Dong-xiao,Luo Kai,et al.Asymmetric bidirectional view synthesis for free viewpoint and three-dimensional video[J].IEEE Transactions on Consumer Electronics,2009,55:2349-2355.

[3] Liu Zhan-wei,An Ping,Liu Su-xing,et al.Arbitrary view generation based on DIBR[J].Proceedings of International Symposium on Intelligent Signal Processing and Communication Systems,2007,32(6):168-171.

[4] Fehn C.Depth-image-based rendering(DIBR),compression and transimission for a new approach on 3D-TV[J].Proceedings of SPIE Stereoscopic Displays and Virtual Reality Systems,2004,29(4):93-104.

[5] Peter H N De,Svitlana Zinger.Free-viewpoint rendering algorithm for 3DTV[J].2nd International Workshop of Advances in Communication,2009,20(1):19-23.

[6] Mcmillan L.An Image-based approach to three-dimensional computer graphics[D].North Carolina:University of North Carolina at Chapel Hill,1997.

[7] Manuel M,Oliveira,Gary Bishop.Factoring 3-D Image Warping Equations into a Pre-Warp Followed by Conventional Texture Mapping[R].UNC Computer Science Technichal Report TR99-002,University of North Caorlina,1999.

[8] Marcato R W.Optimizing an inverse warper[D].Master Thesis,MIT,1998.

[9] 汤杨,吴慧中,肖甫,等.基于空间连贯性的快速图像逆映射算法[J].系统仿真学报,2006,18(3):655-658. Tang Yang,Wu Hui-zhong,Xiao Pu,et al.Efficient Inverse Image Warping Based on Spatial Continuity[J].Journal of System Simulation,2006,18(3):655-658.

[10] Yuji Mori,Norishige Fukushima,Tomohiro Yendo,et al.View generation with 3D warping using depth information for FTV[J]. Special issue on advances in three-dimensional television and video,2009,24(1-2):65-72.

[11] 郁理.基于深度图像绘制的自由视点视频关键技术研究[D].合肥:中国科学技术大学,2010. Yu Li.Reacher on key technology of free-view video on tne basis of depth image rendering[D].Hefei:University of Science and Technology of China,2010.

[12] 张广军.机器视觉[M].北京:科学出版社,2005.

[13] Luo Kai,Li Dong-xiao,Feng Ya-mei,et al.Depth-aided inpainting for disocclusion restoration of multi-view images using depth-image-based rendering[J].Journal of Zhejiang University Science A,2009,10(12):1738-1749.

[14] Zitnick C L,Kang S B,Uyttendaele M,et al.High-quality video view interpolation using a layered representation[C]//ACM SIGGRAPH and ACM Transactions on Graphics,2004:600-608.

[1] SU Han-song,DAI Zhi-tao,LIU Gao-hua,ZHANG Qian-fang. Saliency region detection combining absorbing Markov chain and manifold ranking [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1887-1894.
[2] LYU Chao-hui, SHEN Ying-hua, LI Jing-hua. Depth map inpainting method based on Kinect sensor [J]. 吉林大学学报(工学版), 2016, 46(5): 1697-1703.
[3] WANG Shi-gang, HUO Hao-da, WANG Bo, LYU Yuan-zhi, WU Wei, ZHANG Hang. Image crosstalk degrees detection method in auto-stereoscopic display system [J]. 吉林大学学报(工学版), 2015, 45(5): 1631-1635.
[4] ZHAO Yan, MENG Li-ru,WANG Shi-gang,CHEN He-xin. Improved PSNR evaluation method consistent with human visual perception [J]. 吉林大学学报(工学版), 2015, 45(1): 309-313.
[5] ZHANG Xu, GUO Bao-long, MENG Fan-jie, SUN Wei. Image retrieval based on IPDSH and region division [J]. 吉林大学学报(工学版), 2013, 43(05): 1408-1414.
[6] SANG Ai-jun, MU Sen, WANG Mo-lin, CUI Hai-ting, CHEN He-xin. Multi-view video coding based on multi-dimensional vector matrix [J]. 吉林大学学报(工学版), 2013, 43(04): 1110-1115.
[7] LIN Xiang-yu, TIAN Xiang, CHEN Yao-wu. No-reference video quality assessment based on distortion estimation [J]. 吉林大学学报(工学版), 2013, 43(01): 212-217.
[8] LI Xiao-ni, CHEN He-xin, CHEN Mian-shu, GABBOUJ Moncef. Audio-video synchronous coding based on motion estimation in H.264 [J]. , 2012, 42(05): 1321-1326.
[9] ZHAO Yan, LIU Jing, CHEN He-xin, LIU Bo-xuan. Fast stereo matching algorithm used in stereo video coding based on video plus depth [J]. , 2012, 42(04): 1032-1036.
[10] SUN Jian-zhen, LIU Yuan-an, HU He-fei, YUAN Dong-ming. Coding-aware opportunistic routing based on successful delivery probability [J]. 吉林大学学报(工学版), 2012, 42(01): 218-222.
[11] LIU Guang-yu, BIAN Hong-yu, SHI Hong. Sonar image segmentation based on spectral matting using morphological operations [J]. 吉林大学学报(工学版), 2012, 42(01): 228-233.
[12] LI Bo, WEN Dun-wei, WANG Ke, LIU Jing-xin. Automatic annotation for medical texts based on hidden topic and semantic tree [J]. 吉林大学学报(工学版), 2012, 42(01): 234-239.
[13] LIU Li-li,CHEN He-xin,SANG Ai-jun,HU Tie-gen. Color image coding based on multidimensional vector matrix discrete cosine transform theory [J]. 吉林大学学报(工学版), 2011, 41(6): 1754-1759.
[14] LI Xiao-ni, CHEN He-xin, SUN Yuan, CHEN Mian-shu, LIU Tian. Embedded audio-video synchronization coding based on H.264 [J]. 吉林大学学报(工学版), 2011, 41(05): 1475-1479.
[15] LI Hong-wei, ZHANG Jie, WU Cheng-ke, SONG Rui. Fast multi-symmetry adaptive interpolation filter algorithm [J]. 吉林大学学报(工学版), 2011, 41(05): 1485-1490.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!