关键词: 多媒体数字图像, 交互式, 三维虚拟场景

Abstract: The scale of multimedia digital image data is enormous, including ordinary RGB(Red Green Blue)images and various types of data such as depth maps, texture information, and normal maps. The difficulty of depth estimation leads to low accuracy in 3D scene reconstruction. To effectively address this issue, an interactive 3D virtual scene algorithm for multimedia digital images is proposed. Corners from multimedia digital images are extracted and they are used as initial values to perform a checkerboard edge search to determine the true corners. All corners are used as feature points to perform camera calibration and obtain the corresponding
camera pose for each multimedia digital image. By using the improved PatchMatchNet to perform depth estimation on the reference image, the output depth map is obtained through multiple iterations. By using the method of reprojection to filter the outer points of the depth map and projecting it into the world coordinate system, an interactive 3D virtual scene is finally obtained. The experimental results show that the proposed algorithm can obtain high-precision interactive 3D virtual scene reconstruction results, and the reconstruction time is less than 50 ms.

Key words: multimedia digital images, interactive, 3D virtual scene