基于虚拟现实技术的三维场景图像表面重建算法

doi:10.13229/j.cnki.jdxbgxb20210581

Abstract

Abstract:

Aiming at the problems of low matching precision and complex calculation of traditional 3D scene surface reconstruction feature points， a new algorithm based on virtual reality technology is proposed. The image texture information is processed by wavelet decomposition， the image is encoded quantitatively and the distance between the visual points and images is taken as the measurement value. The appropriate critical value is selected to complete image compression and the redundant data of 3D scene image is eliminated. The heuristic information in the image is calculated， the pheromone matrix is updated， the critical value of the pheromone matrix is used to determine whether the pixel point is the edge point of the image， and the edge information of the 3D scene image is extracted. The minimum recognition distance of 3D scene is calculated by virtual reality equipment， and the deviation between theoretical image projection value and actual projection value is calculated. The pixel value of image surface reconstruction is calibrated by deviation value， and the surface reconstruction target of high precision 3D scene image is completed. The simulation results show that the proposed method can capture the key features of 3D scene image effectively， and the resolution of reconstructed image is improved significantly.

Key words: virtual reality technology, 3D scene, Image surface reconstruction, particle swarm optimization, wavelet decomposition

CLC Number:

TP393

Zhen WANG,Meng GAI,Heng-shuo XU. Surface reconstruction algorithm of 3D scene image based on virtual reality technology[J].Journal of Jilin University(Engineering and Technology Edition), 2022, 52(7): 1620-1625.

Figures/Tables 3

Fig.1

Table 1

Table 2

References 20

1	Lu L, Ma J, Qu S. Value of virtual reality technology in image inspection and 3d geometric modeling[J]. IEEE Access, 2020(99):1-13.
2	Ertugrul I. Characterization of a micro beam fabricated with 3D technology using image processing algorithm[J]. Current Nanoscience, 2020, 16(6):1024-1030.
3	Wang H. Landscape design of coastal area based on virtual reality technology and intelligent algorithm[J]. Journal of Intelligent and Fuzzy Systems, 2019, 37(5):5955-5963.
4	刘长英, 王喜超. 高速列车车头表面三维重建算法[J]. 沈阳工业大学学报, 2019, 41(5):529-533.
	Liu Chang-ying, Wang Xi-chao. 3D reconstruction algorithm of high speed train head surface[J]. Journal of Shenyang University of Technology, 2019, 41(5):529-533.
5	薛俊诗,易辉,吴止锾,等. 一种基于场景图分割的混合式多视图三维重建方法[J].自动化学报,2020,46(4):782-795.
	Xue Jun-shi, Yi Hui, Wu Zhi-huan, et al. A hybrid multi view 3D reconstruction method based on scene graph segmentation[J]. Journal of Automation, 2020,46(4):782-795.
6	杨淑云, 刘永春. 小场景交互式稠密三维重建系统[J]. 图学学报, 2019, 40(2):154-162.
	Yang Shu-yun, Liu Yong-chun. Interactive dense 3D reconstruction system for small scenes[J]. Journal of Graphics, 2019, 40(2):154-162.
7	Huang R, Sun M. Network algorithm real-time depth image 3D human recognition for augmented reality[J]. Journal of Real-Time Image Processing, 2021, 18(2):307-319.
8	葛启杰,史金龙,孙蕴瀚.基于二值空间编解码的结构光三维场景重建[J].激光与光电子学进展,2020,57(2):313-319.
	Ge Qi-jie, Shi Jin-long, Sun Yun-han. Structured light 3D scene reconstruction based on binary space encoding and decoding[J]. Progress in Laser and Optoelectronics, 2020,57(2):313-319.
9	Zhou Y, Shen S, Hu Z. Detail preserved surface reconstruction from point cloud[J]. Sensors, 2019, 19(6):1278.
10	肖雄武.具备结构感知功能的倾斜摄影测量场景三维重建[J]. 测绘学报,2019,48(6):802.
	Xiao Xiong-wu. 3D reconstruction of oblique photogrammetric scene with structure perception function[J]. Journal of Surveying and Mapping, 2019,48(6):802.
11	Han Jing, Xu Qin-feng, Chen Jian-nong, et al. Reconstruction of an underwater scattered image via incoherent modulation instability: erratum[J]. Optics Letters, 2019, 44(6):1443-1449.
12	王年,胡旭阳,朱凡,等. 基于视图感知的单视图三维重建算法[J].电子与信息学报,2020,42(12):3053-3060.
	Wang Nian, Hu Xu-yang, Zhu Fan, et al. Single view 3D reconstruction algorithm based on view perception[J]. Journal of Electronics and Information, 2020,42(12):3053-3060.
13	Li W, Liao Q, Ran Q. Stereo-imaging LSPIV (SI-LSPIV) for 3D water surface reconstruction and discharge measurement in mountain river flows[J]. Journal of Hydrology, 2019, 578(7):124099.
14	刘震, 汪家悦, 陈丽娟. 基于灭点优化的单幅图像三维重建[J]. 浙江工业大学学报, 2019, 47(2):66-71.
	Liu Zhen, Wang Jia-yue, Chen Li-juan. Single image 3D reconstruction based on vanishing point optimization[J]. Journal of Zhejiang University of Technology, 2019, 47(2):66-71.
15	Hafeez J, Lee J, Kwon S, et al. Evaluating feature extraction methods with synthetic noise patterns for image-based modelling of texture-less objects[J]. Remote Sensing, 2020, 12(23):3886.
16	宋燕飞,罗尧治,沈雁彬,等. 基于双目视觉与图像识别的网架结构三维重建[J].空间结构,2020,26(4):28-35, 74.
	Song Yan-fei, Luo Yao-zhi, Shen Yan-bin, et al. 3D reconstruction of grid structure based on binocular vision and image recognition[J]. Space Structure, 2020,26(4):28-35, 74.
17	Tachella J, Altmann Y, Ren X, et al. Bayesian 3d reconstruction of complex scenes from single-photon lidar data[J]. SIAM Journal on Imaging Sciences, 2019, 12(1):521-550.
18	杨锦发,晏磊,赵红颖,等. 融合粗糙深度信息的低纹理物体偏振三维重建[J].红外与毫米波学报,2019,38(6):819-827.
	Yang Jin-fa, Yan Lei, Zhao Hong-ying, et al. Polarimetric 3D reconstruction of low texture objects based on rough depth information[J]. Journal of infrared and Millimeter Wave,2019,38(6):819-827.
19	He K, Sui C, Lyu C, et al. 3D reconstruction of objects with occlusion and surface reflection using a dual monocular structured light system[J]. Applied Optics, 2020, 59(29):9259-9271.
20	陈思园, 宋展, 尹业安. 基于智能手机的三维重建方法[J]. 计算机工程, 2019, 45(3):231-237, 242.
	Chen Si-yuan, Song Zhan, Yin Ye-an. 3D reconstruction method based on smart phone[J]. Computer Engineering, 2019, 45(3):231-237, 242.

Related Articles 15

[1]	Jing QIN,De ZHENG,Yi-qiang PEI,Yong LYU,Qing-peng SU,Ying-bo WANG. Prediction method of engine performance and emission based on PSO-GPR [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(7): 1489-1498.
[2]	Hai-yan XING,Chao LIU,Cheng XU,Yu-huan CHEN,Song-hong-ze WANG. Quantitative metal magnetic memory classification model of weld grades based on particle swarm optimization fuzzy C⁃means [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(3): 525-532.
[3]	Wei LUO,Bo LU,Fei CHEN,Teng MA. Fault diagnosis method of NC turret based on PSO⁃SVM and time sequence [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(2): 392-399.
[4]	Chang-qing DU,Xi-liang CAO,Biao HE,Wei-qun REN. Parameters optimization of dual clutch transmission based on hybrid particle swarm optimization [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(5): 1556-1564.
[5]	Fang-wu MA,Li HAN,Liang WU,Jin-hang LI,Long-fan YANG. Damping optimization of heavy⁃loaded anti⁃vibration platform based on genetic algorithm and particle swarm algorithm [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(5): 1608-1616.
[6]	Xiang-jun YU,Yuan-hui HUAI,Xue-fei LI,De-wu WANG,An YU. Shoveling trajectory planning method for wheel loader based on kriging and particle swarm optimization [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(2): 437-444.
[7]	Shun-fu JIN,Xiu-chen QIE,Hai-xing WU,Zhan-qiang HUO. Clustered virtual machine allocation strategy in cloud computing based on new type of sleep-mode and performance optimization [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(1): 237-246.
[8]	Hong⁃zhi WANG,Fang⁃da JIANG,Ming⁃yue ZHOU. Power allocation of cognitive radio system based on genetic particle swarm optimization [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(4): 1363-1368.
[9]	Yuan-ning LIU,Shuai LIU,Xiao-dong ZHU,Guang HUO,Tong DING,Kuo ZHANG,Xue JIANG,Shu-jun GUO,Qi-xian ZHANG. Iris secondary recognition based on decision particle swarm optimization and stable texture [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(4): 1329-1338.
[10]	Kai XU,Zhi⁃gang CHEN,Jing⁃hua ZHAO,Lu DAI,Feng LI. Layout design method of star sensor based on particle swarm optimization algorithm [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(3): 972-978.
[11]	ZHAO Dong,SUN Ming-yu,ZHU Jin-long,YU Fan-hua,LIU Guang-jie,CHEN Hui-ling. Improved moth-flame optimization method based on combination of particle swarm optimization and simplex method [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1867-1872.
[12]	LIU Yuan-ning, LIU Shuai, ZHU Xiao-dong, CHEN Yi-hao, ZHENG Shao-ge, SHEN Chun-zhuang. LOG operator and adaptive optimization Gabor filtering for iris recognition [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(5): 1606-1613.
[13]	ZANG Guo-shuai, SUN Li-jun. Method based on inertial point for setting depth to rigid layer [J]. 吉林大学学报(工学版), 2018, 48(4): 1037-1044.
[14]	HUANG Hui, FENG Xi-an, WEI Yan, XU Chi, CHEN Hui-ling. An intelligent system based on enhanced kernel extreme learning machine for choosing the second major [J]. 吉林大学学报(工学版), 2018, 48(4): 1224-1230.
[15]	LIU Ying, ZHANG Kai, YU Xiang-jun. Multi-objective optimization of hydrostatic bearing of hollow shaft based on surrogate model [J]. 吉林大学学报(工学版), 2017, 47(4): 1130-1137.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

Comments

Recommended 0

No Suggested Reading articles found!

帧编号	文献［4］	文献［5］	本文方法
1	1025×769	1025×769	1290×1030
2	1036×770	1290×1030	1290×1030
3	650×490	750×520	1290×1030
4	1290×1030	1290×1100	1290×1030
5	1025×769	1250×1010	1290×1030
6	1025×769	1290×1100	1290×1030
7	650×490	750×520	1290×1030
8	1290×1030	1290×1100	1290×1030
9	650×490	700×510	1290×1030

Surface reconstruction algorithm of 3D scene image based on virtual reality technology

RICH HTML

PDF (PC)