吉林大学学报(工学版) ›› 2015, Vol. 45 ›› Issue (5): 1688-1695.doi: 10.13229/j.cnki.jdxbgxb201505044

Previous Articles     Next Articles

Detection handheld phone use by driver based on machine vision

ZHANG Bo, WANG Wen-jun, WEE Minkooc, CHENG Bo   

  1. State Key Laboratory of Automotive Safety and Energy, Tsinghua University, Beijing 100084, China
  • Received:2014-03-06 Online:2015-09-01 Published:2015-09-01

Abstract: A machine vision based method is proposed to detect handheld phone use behavior. In this method, first, Active Shape Model (ASM) algorithm is used to segment the skin-color region of the driver face, and the region is tracked by F-B error algorithm when the head moves. Second, an adaptive skin-color range extraction algorithm is proposed to detect the skin-color pixels and determine the candidates of hand images. Third, Co-occurrence Matrix of Oriented Gradients (CMOG) is proposed, which combined with Histogram Oriented Gradient (HOG) feature is used to detect the real hand image from the candidates. Finally, three modes logic discriminating method is used to identify the driver state. Experiment results show that the proposed machine vision based method can detect the handheld phone use behavior effectively.

Key words: information processing technology, driving behavior, machine vision, handheld phone

CLC Number: 

  • TN971
[1] Davis M, Payne N, Mozee S. Cell phone use while driving becoming a deadly problem[J]. The MURC Digest, 2010, 6(1):1-4.
[2] Mattews R, Legg S, Charlton S. The effect of cell phone type on drivers subjective workload during concurrent driving and conversing[J]. Accident Analysis and Prevention, 2003(35): 451-457.
[3] 李平凡,王殿海,刘东波,等. 驾驶中拨打手机对驾驶人脑力负荷及驾驶行为的影响分析[J]. 交通信息与安全,2010, 28(4): 103-107. Li Ping-fan, Wang Dian-hai, Liu Dong-bo, et al. Effect of using cell phone while driving on mental workload and driving behavior[J]. Journal of Transportation Information and Safety, 2010, 28(4): 103-107.
[4] Tornros J E B, Bolling A K. Mobile phone use-effects of handheld and handsfree phones on driving performance[J]. Accident Ayalysis and Prevention, 2005, 37(5):902-909.
[5] Ishigami Y, Klein P M. Is a hands-free phone safer than a handheld phone?[J]. Journal of Safety Research, 2009, 40(2):157-164.
[6] Choi Jung-hee. Method of controlling prohibition of cellular phone in vehicle[P]. Korea:1020040094926,2004-11-12.
[7] Kakumanu P,Makrogiannis S,Bourbakis N.A survey of
skin-color modeling and detection methods[J]. Pattern Recognition, 2007 (40):1106-1122.
[8] Dadgostar F, Sarrafzadeh A. An adaptive real-time skin detector based on hue thresholding: a comparison on two motion tracking methods[J]. Pattern Recognition Letters, 2006(27):1342-1352.
[9] Cootes T F, Twining C J, Taylor C J. Diffeomorphic statistical shape model[J]. Image and Vision Computing, 2008, 26(3):326-332.
[10] 林立, 黄磊, 刘昌平. 一种有效的儿童照合成方法[J]. 自动化学报, 2012, 38(12): 1941-1949. Lin Li, Huang Lei, Liu Chang-ping. An effective method for child picture synthesi[J]. Acta Automatica Sinica, 2012, 38(12): 1941-1949.
[11] Viola P, Jones M. Rapid object detection using a boosted cascade of simple features[C]∥Conference on Computer Vision and Pattern Recognition, Kauai, USA, 2001, I-511- I-518.
[12] Kalal Z, Mikolajczyk K, Matas J. Forward-backward error automatic detection of tracking failures[C]∥International Conference on Pattern Recognition, Istanbul, Turkey, 2010:2756-2759.
[13] Lucas B D, Kanade T. An iterative image registration technique with an application to stereo vision[C]∥Proceeding of 7th International Joint Conference on Artificial Intelligence, Columbia, British, 1981:674-679.
[14] Zhu Q, Cheng K T, Wu C T, et al. Adaptive learning of an accurate skin-color model[C]∥International Conference on Automatic Face and Gesture Recognition, South Korea, Seoul, 2004:37-42.
[15] Kovac J, Peer P, Solina F. Human skin color clustering for face detection[C]∥Proceedings of EUROCON 2003, Ljubljana, Slovenia, 2003:144-148.
[16] Cheng Y Z. Mean shift, mode seeking, and clustering[C]∥IEEE Transactions on Pattern Analysis and Machine Intelligence, IEEE, 1995:790-799.
[17] Cho K M, Jang J H, Hong K S. Adaptive skin-color filter[J]. Pattern Recognition, 2001(34):1067-1073.
[18] Dalal N, Triggs B. Histograms of oriented gradients for human detection[C]∥Conference on Computer Vision and Pattern Recognition, San Diego, USA, 2005:886-893.
[19] 张毓晋. 图像分析[M]. 北京: 清华大学出版社, 2005: 282-289.
[1] LIU En-ze,WU Wen-fu. Agricultural surface multiple feature decision fusion disease judgment algorithm based on machine vision [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1873-1878.
[2] YING Huan,LIU Song-hua,TANG Bo-wen,HAN Li-fang,ZHOU Liang. Efficient deterministic replay technique based on adaptive release strategy [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1917-1924.
[3] LIU Zhong-min,WANG Yang,LI Zhan-ming,HU Wen-jin. Image segmentation algorithm based on SLIC and fast nearest neighbor region merging [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1931-1937.
[4] SHAN Ze-biao,LIU Xiao-song,SHI Hong-wei,WANG Chun-yang,SHI Yao-wu. DOA tracking algorithm using dynamic compressed sensing [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1938-1944.
[5] YAO Hai-yang, WANG Hai-yan, ZHANG Zhi-chen, SHEN Xiao-hong. Reverse-joint signal detection model with double Duffing oscillator [J]. 吉林大学学报(工学版), 2018, 48(4): 1282-1290.
[6] QUAN Wei, HAO Xiao-ming, SUN Ya-dong, BAI Bao-hua, WANG Yu-ting. Development of individual objective lens for head-mounted projective display based on optical system of actual human eye [J]. 吉林大学学报(工学版), 2018, 48(4): 1291-1297.
[7] LIN Jin-hua, WANG Yan-jie, WANG Lu, YAO Yu. Real-time surface reconstruction based global camera pose optimization [J]. 吉林大学学报(工学版), 2018, 48(3): 909-918.
[8] CHEN Mian-shu, SU Yue, SANG Ai-jun, LI Pei-peng. Image classification methods based on space vector model [J]. 吉林大学学报(工学版), 2018, 48(3): 943-951.
[9] CHEN Tao, CUI Yue-han, GUO Li-min. Improved algorithm of multiple signal classification for single snapshot [J]. 吉林大学学报(工学版), 2018, 48(3): 952-956.
[10] MENG Guang-wei, LI Rong-jia, WANG Xin, ZHOU Li-ming, GU Shuai. Analysis of intensity factors of interface crack in piezoelectric bimaterials [J]. 吉林大学学报(工学版), 2018, 48(2): 500-506.
[11] LIN Jin-hua, WANG Yan-jie, SUN Hong-hai. Improved feature-adaptive subdivision for Catmull-Clark surface model [J]. 吉林大学学报(工学版), 2018, 48(2): 625-632.
[12] WANG Ke, LIU Fu, KANG Bing, HUO Tong-tong, ZHOU Qiu-zhan. Bionic hypocenter localization method inspired by sand scorpion in locating preys [J]. 吉林大学学报(工学版), 2018, 48(2): 633-639.
[13] YU Hua-nan, DU Yao, GUO Shu-xu. High-precision synchronous phasor measurement based on compressed sensing [J]. 吉林大学学报(工学版), 2018, 48(1): 312-318.
[14] WANG Fang-shi, WANG Jian, LI Bing, WANG Bo. Deep attribute learning based traffic sign detection [J]. 吉林大学学报(工学版), 2018, 48(1): 319-329.
[15] LIU Dong-liang, WANG Qiu-shuang. Instantaneous velocity extraction method on NGSLM data [J]. 吉林大学学报(工学版), 2018, 48(1): 330-335.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!