›› 2012, Vol. 42 ›› Issue (05): 1321-1326.

Previous Articles     Next Articles

Audio-video synchronous coding based on motion estimation in H.264

LI Xiao-ni1, CHEN He-xin1, CHEN Mian-shu1, GABBOUJ Moncef2   

  1. 1. College of Communication Engineering,Jilin University,Changchun 130022,China;
    2. Department of Signal Processing, Tampere University of Technology, Tampere FI-33101,Finland
  • Received:2011-08-22 Online:2012-09-01 Published:2012-09-01

PDF (PC)

318

Abstract: To solve the problem of audio-video synchronous coding effectively, an embedding scheme is proposed. This scheme applies the quarter-pixel motion search during the motion estimation in H.264. At the transmitter terminal, according to the mapping rule between the binary audio bits and the search points, the audio bits are embedded into the video signal by modulating the best search point in the quarter-pixel motion estimation. Then the synchronous coding is applied to the hybrid signals. At the receiver terminal, the audio information bits are extracted from the video stream according to the embedding rule. Then the audio and video signals are reconstructed respectively. Experiment results show that the proposed scheme can achieve audio-video synchronous coding with low embedding cost and good performance in quality of video and audio signals.

Key words: information processing, synchronous coding, quarter-pixel motion estimation, audio and video

CLC Number: 

  • TN919.81
[1] Mohamed El-Helaly, Aishy Amer. Synchronization of processed audio-video signals using time-stamps//IEEE International Conference on Image Processing, San Antonio, 2007.
[2] Zhang Jing-feng, Li Ying, Wei Yan-na. Using timestamp to realize audio-video synchronization in Real-Time streaming media transmission//International Conference on Audio, Language and Image Processing, Shanghai, China, 2008.
[3] Sucharu Aggarwal, Alka Jindal. Comprehensive overview of various lip synchronization techniques//IEEE International Symposium on Biometrics and Security Technologies, Islamabad, 2008.
[4] Oh Kyung-Geune, Jung Chan-Yul, Lee Yong-Gyu, et al. Real-Time lip synchronization between Text-To-Speech (TTS) system and robot mouth//19th IEEE International Symposium on Robot and Human Interactive Communication, Viareggio, Italy, 2010.
[5] Li Xiao-ni, Chen He-xin, Wang Da-zhong, et al. Data hiding in encoded video sequences based on H.264//2010 3rd IEEE International Conference on Computer Science and Information Technology(ICCSIT), Chengdu, China, 2010.
[6] Qi Li-feng, Chen He-xin, Zhao Yan. New synchronization scheme between audio and video//Eighth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing, Qingdao, China, 2007.
[7] Li Bing, Shi Mei-Qiang. Audio-Video synchronization coding approach based on H.264/AVC[J]. IEICE Electronics Express, 2009, 6(22): 1556-1561.
[8] Chen Wei-wei, Li Jin, Gabbouj Moncef, et al. Lossless audio hiding method for synchronous Audio-Video coding//36th International Conference on Acoustics, Speech and Signal Processing(ICASSP), Prague, Caech Republic, 2011.
[9] ITU-T Rec. H.264(03/2010). Advanced video coding for generic audiovisual service[S].
[1] YING Huan,LIU Song-hua,TANG Bo-wen,HAN Li-fang,ZHOU Liang. Efficient deterministic replay technique based on adaptive release strategy [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1917-1924.
[2] LIU Zhong-min,WANG Yang,LI Zhan-ming,HU Wen-jin. Image segmentation algorithm based on SLIC and fast nearest neighbor region merging [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1931-1937.
[3] SHAN Ze-biao,LIU Xiao-song,SHI Hong-wei,WANG Chun-yang,SHI Yao-wu. DOA tracking algorithm using dynamic compressed sensing [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1938-1944.
[4] YAO Hai-yang, WANG Hai-yan, ZHANG Zhi-chen, SHEN Xiao-hong. Reverse-joint signal detection model with double Duffing oscillator [J]. 吉林大学学报(工学版), 2018, 48(4): 1282-1290.
[5] QUAN Wei, HAO Xiao-ming, SUN Ya-dong, BAI Bao-hua, WANG Yu-ting. Development of individual objective lens for head-mounted projective display based on optical system of actual human eye [J]. 吉林大学学报(工学版), 2018, 48(4): 1291-1297.
[6] CHEN Mian-shu, SU Yue, SANG Ai-jun, LI Pei-peng. Image classification methods based on space vector model [J]. 吉林大学学报(工学版), 2018, 48(3): 943-951.
[7] CHEN Tao, CUI Yue-han, GUO Li-min. Improved algorithm of multiple signal classification for single snapshot [J]. 吉林大学学报(工学版), 2018, 48(3): 952-956.
[8] MENG Guang-wei, LI Rong-jia, WANG Xin, ZHOU Li-ming, GU Shuai. Analysis of intensity factors of interface crack in piezoelectric bimaterials [J]. 吉林大学学报(工学版), 2018, 48(2): 500-506.
[9] LIN Jin-hua, WANG Yan-jie, SUN Hong-hai. Improved feature-adaptive subdivision for Catmull-Clark surface model [J]. 吉林大学学报(工学版), 2018, 48(2): 625-632.
[10] WANG Ke, LIU Fu, KANG Bing, HUO Tong-tong, ZHOU Qiu-zhan. Bionic hypocenter localization method inspired by sand scorpion in locating preys [J]. 吉林大学学报(工学版), 2018, 48(2): 633-639.
[11] YU Hua-nan, DU Yao, GUO Shu-xu. High-precision synchronous phasor measurement based on compressed sensing [J]. 吉林大学学报(工学版), 2018, 48(1): 312-318.
[12] WANG Fang-shi, WANG Jian, LI Bing, WANG Bo. Deep attribute learning based traffic sign detection [J]. 吉林大学学报(工学版), 2018, 48(1): 319-329.
[13] LIU Dong-liang, WANG Qiu-shuang. Instantaneous velocity extraction method on NGSLM data [J]. 吉林大学学报(工学版), 2018, 48(1): 330-335.
[14] TANG Kun, SHI Rong-hua. Detection of wireless sensor network failure area based on butterfly effect signal [J]. 吉林大学学报(工学版), 2017, 47(6): 1939-1948.
[15] LI Juan, MENG Ke-xin, LI Yue, LIU Hui-li. Seismic signal noise suppression based on similarity matched Wiener filtering [J]. 吉林大学学报(工学版), 2017, 47(6): 1964-1968.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright © Journal of Jilin University(Engineering and Technology Edition), All Rights Reserved.
Tel: +86-431-85095297　Fax: +86-431-85094074　E-mail: xbgxb@jlu.edu.cn
Powered by Beijing Magtech Co. Ltd