Journal of Jilin University Science Edition ›› 2024, Vol. 62 ›› Issue (4): 895-904.

Previous Articles     Next Articles

Facial Super-resolution Reconstruction Algorithm Based on 3D  Prior Features

YAO Hanqun1, LIU Guangwen1, WANG Chao2, YANG Yining3, CAI Hua1, FU Qiang4   

  1. 1. School of Electronic Information Engineer, Changchun University of Science and Technology, Changchun 130022, China; 2. National and Local Joint Engineering Research Center for Space Optoelectronics Technology, Changchun University of Science and Technology, Changchun 130022, China; 3. National Key Laboratory of Electromagnetic Space Security, Tianjin 300308, China; 4. School of Opto-Electronic Engineer, Changchun University of Science and Technology, Changchun 130022, China
  • Received:2023-05-26 Online:2024-07-26 Published:2024-07-26

Abstract: In order to effectively solve  the problem of facial super-resolution feature recovery in complex environments, we proposed a novel facial super-resolution network. By integrating 3D rendering prior knowledge and a dual attention mechanism, the network enhanced the understanding of the facial spatial position and overall structure while improving the ability to recover detailed information. The experimental results on the CelebAMask-HQ dataset show that  the proposed algorithm achieves peak signal-to-noise ratio and  structural similarity of 28.76 dB  and  0.827 5 for  downsampled faces magnified by 4 times, and  26.29 dB and 0.754 9 for downsampled faces magnified by 8 times.   Compared with the similar SAM3D algorithm, the proposed algorithm improves the peak signal-to-noise ratio and  structural similarity by  4.09 and 1.93 percentage points when dealing with  4 times  downsampling, and by 2.02 and 4.54 percentage points  when dealing with 8 times downsampling, respectively.  This proves the superiority of the proposed  algorithm and  also indicates that  facial super-resolution recovery can achieve more realistic and clear visual effects in practical applications.

Key words: machine vision, facial super-resolution, 3D prior, attention mechanism

CLC Number: 

  • TP391