Journal of Jilin University (Information Science Edition) ›› 2021, Vol. 39 ›› Issue (6): 700-705.

Previous Articles     Next Articles

Training System of Immersive Pronunciation Rehabilitation for Hearing Impaired Children Based on Virtual Reality VR Technology

YANG Yongji a,b , ZHAO Jian a,b , SHI Lijuan b,c , CUI Yuqing b,c , ZHANG Zhiwei c , Xiao Zhiguo a,b   

  1. a. College of Computer Science and Technology; b. Jilin Key Laboratory of Human Health State Identification and Function Enhancement; c. College of Electronic Information Engineering, Changchun University, Changchun 130022, China
  • Received:2021-08-21 Online:2021-12-01 Published:2021-12-02

Abstract: Aiming at the problem that patients' enthusiasm for active training is gradually weakened in the traditional pronunciation rehabilitation training of hearing-impaired children, an immersive pronunciation rehabilitation training system for hearing-impaired children based on Virtual Reality VR technology is designed. The system uses the Unity3D Engine to develop the rehabilitation scene and uses the virtual reality helmet as the output to display the virtual environment. It can reproduce the virtual environment with a high degree of restoration and has a high sense of immersion. Through the face capture technology, the standard pronunciation and mouth shape are trained. Through the high-definition visual virtual reality imaging system and hand motion capture system, the human-computer interaction is realized to trigger the training function, and the virtual reality technology is used to better help the hearing-impaired children with immersive pronunciation rehabilitation training. The results show that the pronunciation training method in the system can effectively improve the pronunciation ability of hearing-impaired children and play a positive role in the rehabilitation of patients' language ability.

Key words: virtual reality technology, immersive pronunciation rehabilitation training, Unity3D engine, human-computer interaction

CLC Number: 

  • TP3