吉林大学学报(工学版) ›› 2014, Vol. 44 ›› Issue (2): 421-426.doi: 10.13229/j.cnki.jdxbgxb201402023

• paper • Previous Articles     Next Articles

Complex interactive activity recognition with spatial-temporal relationship

WANG Sheng-sheng, YANG Feng, LIU Yi-ting, WANG Wei-lie, LI Yang   

  1. College of Computer Science and Technology, Jilin University, Changchun 130012, China
  • Received:2013-02-20 Online:2014-02-01 Published:2014-02-01

Abstract:

A complex interactive activity recognition approach with spatial-temporal relation and an extended Hidden Markov Model with multi-observations and multi-layers is presented here. Interactive activities involving multi-objects are naturally hierarchical and related with spatial-temporal relationship. The multi-granularity features (group, two persons and single person) are used. A new model, Multi-observations Three-Layers Hidden Markov Model (MTHMM), corresponding to these features is put forward. The experiments show that the new feature extraction method and the new model have a good performance and a fair robustness in complex interactive activity recognition.

Key words: artificial intelligence, spatial-temporal relation, interactive activity, hidden Markov model with multi-observations and three-layers, features with three layers

CLC Number: 

  • TP18

[1] 王丹, 张祥合. 基于HOG 和SVM 的人体行为仿生识别方法[J]. 吉林大学学报:工学版, 2013, 43(增刊):489-492. Wang Dan, Zhang Xiang-he. Biomimetic recognition method of human behavior based on HOG and SVM[J].Journal of Jilin University(Engineering and Technology Edition), 2013, 43(Sup.):489-492.

[2] 周宝余, 臧雪柏, 赵浩宇, 等. 基于QT的无线多路视频监控系统[J].吉林大学学报:工学版, 2011, 41(增刊1):204-207. Zhou Bao-yu, Zang Xue-bai, Zhao Hao-yu, et al. Wireless multiway video monitor system based on QT[J]. Journal of Jilin University(Engineering and Technology Edition), 2011, 41(Sup.1):204-207.

[3] Rea N, Dahyot R, Kokaram A. Image and Video Retrieval[M]. Dublin, Ireland: Springer, 2004: 88-97.

[4] Ma Xiang, Bashir F, Khokhar A A, et al. Event analysis based on multiple interactive motion trajectories[J].IEEE Transactions on Circuits and Systems for Video Technology, 2009, 19(3): 397-406.

[5] Guo Ping, Miao Zhen-jiang. Multi-person activity recognition through hierarchical and observation decomposed HMM[C]//Multimedia and Expo (ICME).Suntec City: IEEE, 2010.

[6] Rabiner Lawrence R. A tutorial on hidden Markov models and selected applications in speech recognition[J]. Proceedings of the IEEE, 1989, 77(2): 257-286.

[7] Matthew Brand, Oliver Nuria, Pentland Alex. Coupled hidden Markov models for complex action recognition[C]//IEEE Computer Vision and Pattern Recognition.San Juan: IEEE, 1997.

[8] Zoubin Ghahramani, Jordan Michael I. Factorial hidden markov models[J].Machine Learning, 1997, 29(2/3): 245-273.

[9] Pradeep N, Ramakant N. Coupled hidden semi markov models for activity recognition[C]//Workshop on Motion and Video Computing -WMVC, Austin, TX, USA: IEEE, 2007.

[10] Liu Chin-De, Chung Yi-Nung, Chung Pau-Choo. An interaction-embedded HMM framework for human behavior understanding: with nursing environments as examples[J]. IEEE Transactions On Information Technology In Biomedicine, 2010, 14(5): 1236-1246.

[11] Matthias Delafontaine, Cohn Anthony G, van de Weghe Nico. Implementing a qualitative calculus to analyze moving point objects[J]. Expert Systems with Applications, 2011, 38(5): 5187-5196.

[1] DONG Sa, LIU Da-you, OUYANG Ruo-chuan, ZHU Yun-gang, LI Li-na. Logistic regression classification in networked data with heterophily based on second-order Markov assumption [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(5): 1571-1577.
[2] GU Hai-jun, TIAN Ya-qian, CUI Ying. Intelligent interactive agent for home service [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(5): 1578-1585.
[3] WANG Xu, OUYANG Ji-hong, CHEN Gui-fen. Measurement of graph similarity based on vertical dimension sequence dynamic time warping method [J]. 吉林大学学报(工学版), 2018, 48(4): 1199-1205.
[4] ZHANG Hao, ZHAN Meng-ping, GUO Liu-xiang, LI Zhi, LIU Yuan-ning, ZHANG Chun-he, CHANG Hao-wu, WANG Zhi-qiang. Human exogenous plant miRNA cross-kingdom regulatory modeling based on high-throughout data [J]. 吉林大学学报(工学版), 2018, 48(4): 1206-1213.
[5] HUANG Lan, JI Lin-ying, YAO Gang, ZHAI Rui-feng, BAI Tian. Construction of disease-symptom semantic net for misdiagnosis prompt [J]. 吉林大学学报(工学版), 2018, 48(3): 859-865.
[6] LI Xiong-fei, FENG Ting-ting, LUO Shi, ZHANG Xiao-li. Automatic music composition algorithm based on recurrent neural network [J]. 吉林大学学报(工学版), 2018, 48(3): 866-873.
[7] LIU Jie, ZHANG Ping, GAO Wan-fu. Feature selection method based on conditional relevance [J]. 吉林大学学报(工学版), 2018, 48(3): 874-881.
[8] WANG Xu, OUYANG Ji-hong, CHEN Gui-fen. Heuristic algorithm of all common subsequences of multiple sequences for measuring multiple graphs similarity [J]. 吉林大学学报(工学版), 2018, 48(2): 526-532.
[9] YANG Xin, XIA Si-jun, LIU Dong-xue, FEI Shu-min, HU Yin-ji. Target tracking based on improved accelerated gradient under tracking-learning-detection framework [J]. 吉林大学学报(工学版), 2018, 48(2): 533-538.
[10] LIU Xue-juan, YUAN Jia-bin, XU Juan, DUAN Bo-jia. Quantum k-means algorithm [J]. 吉林大学学报(工学版), 2018, 48(2): 539-544.
[11] QU Hui-yan, ZHAO Wei, QIN Ai-hong. A fast collision detection algorithm based on optimization operator [J]. 吉林大学学报(工学版), 2017, 47(5): 1598-1603.
[12] LI Jia-fei, SUN Xiao-yu. Clustering method for uncertain data based on spectral decomposition [J]. 吉林大学学报(工学版), 2017, 47(5): 1604-1611.
[13] SHAO Ke-yong, CHEN Feng, WANG Ting-ting, WANG Ji-chi, ZHOU Li-peng. Full state based adaptive control of fractional order chaotic system without equilibrium point [J]. 吉林大学学报(工学版), 2017, 47(4): 1225-1230.
[14] WANG Sheng-sheng, WANG Chuang-feng, GU Fang-ming. Spatio-temporal reasoning for OPRA direction relation network [J]. 吉林大学学报(工学版), 2017, 47(4): 1238-1243.
[15] MA Miao, LI Yi-bin. Multi-level image sequences and convolutional neural networks based human action recognition method [J]. 吉林大学学报(工学版), 2017, 47(4): 1244-1252.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!