吉林大学学报(工学版) ›› 2013, Vol. 43 ›› Issue (增刊1): 256-259.

• 论文 • 上一篇    下一篇

基于深度图像和半像素的虚拟视点绘制

赵岩, 汪敬媛, 陈贺新, 刘静, 王珂玮   

  1. 吉林大学 通信工程学院,长春 130012
  • 收稿日期:2012-06-15 发布日期:2013-06-01
  • 通讯作者: 汪敬媛(1986-),女,硕士研究生.研究方向:数字图像处理研究.E-mail:jingyuan198634@163.com E-mail:jingyuan198634@163.com
  • 作者简介:赵岩(1971-),女,副教授.研究方向:视频编码.E-mail:zhao_y@jlu.edu.cn
  • 基金资助:

    国家自然科学基金项目(60872072,60832002);吉林大学杰出青年基金项目(200905018).

Virtual view rendering based on depth image and half pixel precision

ZHAO Yan, WANG Jing-yuan, CHEN He-xin, LIU Jing, WANG Ke-wei   

  1. College of Communication Engineering, Jilin University, Changchun 130012, China
  • Received:2012-06-15 Published:2013-06-01

摘要:

为提高虚拟视点图像的绘制精度,提出了一种基于深度图像和半像素的虚拟视点绘制方法。该方法首先对参考图像进行预处理,包括图像的半像素处理和亮度校正,然后利用正向3D图像映射获得虚拟视点的图像和深度信息,再利用逆向3D图像映射填补由深度信息不准确等因素产生的部分空洞,并根据深度信息擦除背景伪影,最后根据空洞类型的不同采用不同的方法进行空洞填补。实验结果证明,利用该方法可以绘制出令人满意的虚拟视点图像。

关键词: 基于深度图像的绘制, 半像素, 3D图像映射, 空洞填补

Abstract:

In order to improve the rendering accuracy,an algorithm based on depth image and half pixel precision was proposed.Firstly the reference images were preprocessed,including the half-pixel processing and brightness correction,then forward 3D image warping is utilized to generate the image and depth map of the virtual view,inverse 3D image warping was used to fill part of holes caused by some factors,such as inaccurate depth information,and then ghosting was erased according to depth comparison,finally different methods was used to fill the remaining holes according to the types of the holes.The experimental results show that the proposed method can obtain satisfactory rendering results.

Key words: depth image based rendering, half pixel precision, 3D image warping, hole filling

中图分类号: 

  • TN919.8

[1] Tanimoto M.Overview of free viewpoint television [J].Signal Processing Image Communication,2006,21(6):454-461.

[2] Feng Ya-mei,Li Dong-xiao,Luo Kai,et al.Asymmetric bidirectional view synthesis for free viewpoint and three-dimensional video[J].IEEE Transactions on Consumer Electronics,2009,55:2349-2355.

[3] Liu Zhan-wei,An Ping,Liu Su-xing,et al.Arbitrary view generation based on DIBR[J].Proceedings of International Symposium on Intelligent Signal Processing and Communication Systems,2007,32(6):168-171.

[4] Fehn C.Depth-image-based rendering(DIBR),compression and transimission for a new approach on 3D-TV[J].Proceedings of SPIE Stereoscopic Displays and Virtual Reality Systems,2004,29(4):93-104.

[5] Peter H N De,Svitlana Zinger.Free-viewpoint rendering algorithm for 3DTV[J].2nd International Workshop of Advances in Communication,2009,20(1):19-23.

[6] Mcmillan L.An Image-based approach to three-dimensional computer graphics[D].North Carolina:University of North Carolina at Chapel Hill,1997.

[7] Manuel M,Oliveira,Gary Bishop.Factoring 3-D Image Warping Equations into a Pre-Warp Followed by Conventional Texture Mapping[R].UNC Computer Science Technichal Report TR99-002,University of North Caorlina,1999.

[8] Marcato R W.Optimizing an inverse warper[D].Master Thesis,MIT,1998.

[9] 汤杨,吴慧中,肖甫,等.基于空间连贯性的快速图像逆映射算法[J].系统仿真学报,2006,18(3):655-658. Tang Yang,Wu Hui-zhong,Xiao Pu,et al.Efficient Inverse Image Warping Based on Spatial Continuity[J].Journal of System Simulation,2006,18(3):655-658.

[10] Yuji Mori,Norishige Fukushima,Tomohiro Yendo,et al.View generation with 3D warping using depth information for FTV[J]. Special issue on advances in three-dimensional television and video,2009,24(1-2):65-72.

[11] 郁理.基于深度图像绘制的自由视点视频关键技术研究[D].合肥:中国科学技术大学,2010. Yu Li.Reacher on key technology of free-view video on tne basis of depth image rendering[D].Hefei:University of Science and Technology of China,2010.

[12] 张广军.机器视觉[M].北京:科学出版社,2005.

[13] Luo Kai,Li Dong-xiao,Feng Ya-mei,et al.Depth-aided inpainting for disocclusion restoration of multi-view images using depth-image-based rendering[J].Journal of Zhejiang University Science A,2009,10(12):1738-1749.

[14] Zitnick C L,Kang S B,Uyttendaele M,et al.High-quality video view interpolation using a layered representation[C]//ACM SIGGRAPH and ACM Transactions on Graphics,2004:600-608.

[1] 苏寒松,代志涛,刘高华,张倩芳. 结合吸收Markov链和流行排序的显著性区域检测[J]. 吉林大学学报(工学版), 2018, 48(6): 1887-1894.
[2] 吕朝辉, 沈萦华, 李精华. 基于Kinect的深度图像修复方法[J]. 吉林大学学报(工学版), 2016, 46(5): 1697-1703.
[3] 王世刚, 霍昊达, 王博, 吕源治, 武伟, 张航. 自由立体显示系统中的图像串扰度检测[J]. 吉林大学学报(工学版), 2015, 45(5): 1631-1635.
[4] 赵岩,孟丽茹,王世刚,陈贺新. 符合人眼视觉感知特性的改进PSNR评价方法[J]. 吉林大学学报(工学版), 2015, 45(1): 309-313.
[5] 张旭, 郭宝龙, 孟繁杰, 孙伟. 基于IPDSH兴趣点空间区域划分的图像检索[J]. 吉林大学学报(工学版), 2013, 43(05): 1408-1414.
[6] 桑爱军, 穆森, 王墨林, 崔海廷, 陈贺新. 基于多维矢量矩阵的多视角视频编码[J]. 吉林大学学报(工学版), 2013, 43(04): 1110-1115.
[7] 林翔宇, 田翔, 陈耀武. 基于失真度估计的无参考视频质量评价[J]. 吉林大学学报(工学版), 2013, 43(01): 212-217.
[8] 李晓妮, 陈贺新, 陈绵书, 蒙塞夫·嘎博基. 基于H.264运动估计的音视频同步编码技术[J]. , 2012, 42(05): 1321-1326.
[9] 赵岩, 刘静, 陈贺新, 刘伯轩. 用于单视加深度视频编码的快速立体匹配算法[J]. , 2012, 42(04): 1032-1036.
[10] 孙建镇, 刘元安, 胡鹤飞, 袁东明. 基于成功递送率的编码感知机会路由机制[J]. 吉林大学学报(工学版), 2012, 42(01): 218-222.
[11] 刘光宇, 卞红雨, 石红. 结合形态学运算的谱抠图声纳图像分割法[J]. 吉林大学学报(工学版), 2012, 42(01): 228-233.
[12] 李博, 文敦伟, 王珂, 刘景鑫. 基于隐含主题和语义树的医学文本自动批注[J]. 吉林大学学报(工学版), 2012, 42(01): 234-239.
[13] 刘丽丽,陈贺新,桑爱军,胡铁根. 基于多维矢量矩阵正交变换理论的彩色图像压缩编码[J]. 吉林大学学报(工学版), 2011, 41(6): 1754-1759.
[14] 李晓妮,陈贺新,孙元,陈绵书,刘添. 基于H.264的嵌入式音视频同步编码技术[J]. 吉林大学学报(工学版), 2011, 41(05): 1475-1479.
[15] 李宏伟,张捷,吴成柯,宋锐. 多对称性快速自适应插值滤波算法[J]. 吉林大学学报(工学版), 2011, 41(05): 1485-1490.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!