吉林大学学报(信息科学版) ›› 2015, Vol. 33 ›› Issue (5): 516-.

• 论文 • 上一篇    下一篇

基于光流与LBP-TOP 特征结合的微表情识别

张轩阁, 田彦涛, 郭艳君, 王美茜   

  1. 吉林大学通信工程学院, 长春130022
  • 出版日期:2015-09-30 发布日期:2015-12-30
  • 作者简介:张轩阁(1986—), 男, 沈阳人, 吉林大学硕士研究生, 主要从事模式识别与机器视觉研究, (Tel)86-18909881400(E-mail)zhangxuange1986@163. com; 田彦涛(1958—), 男, 长春人, 吉林大学教授, 博士生导师, 主要从事复杂系统建模、优化与控制研究, (Tel)86-13844889256(E-mail)tianyt@ jlu. edu. cn。
  • 基金资助:

    吉林省科技发展计划重点基金资助项目(20071152)

Micro-Expression Recognition Based on Feature
Combination of Optical Flow and LBP-TOP

ZHANG Xuange, TIAN Yantao, GUO Yanjun, WANG Meiqian   

  1. College of Communication Engineering, Jilin University, Changchun 130022, China
  • Online:2015-09-30 Published:2015-12-30

摘要:

微表情区别于普通的面部表情, 具有持续时间短、面部强度低的特点, 往往难以有效识别, 制约了该领域的研究。针对上述难点, 提出一种新颖的特征结合方法。采用全局光流技术在相邻帧间进行计算, 得到微弱光流, 通过传递前后各帧的运动信息, 在相隔多帧的两幅图像间体现更为明显的变化, 解决了短历时和动作微弱的难题; 将光流特征与LBP-TOP(Local Binary Patterns from Three Orthogonal Planes)算子提取的时空局部纹理特征相结合, 补充描述人脸大多数区域的细节信息。选择随机森林分类器进行实验, 实验结果表明, 两种特征具有很好的互补性, 在CASMEII 数据库下, 能识别5 类情感, 准确率由40. 50%提高至64. 46%, 类间区分度也有相应改善。

关键词: 微表情, 光流, LBP-TOP, 随机森林

Abstract:

Different from ordinary facial expression, micro-expression has the characteristics of short duration andlow intensity, which is often difficult to be identified effectively, resulting in the limitation of research in this field. Dealing with these difficulties, a novel feature combination method was proposed. Calculation using the global optical flow technology was carried out in the adjacent frames to obtain faint optical flow. The motion information of each two adjacent frames was passed by, so that the changes were significant between the images of two frames at a distance, solving the problem of short duration and weak action. The optical flow feature and space-temporal local texture feature extracted by LBP-TOP(Local Binary Patterns from Three Orthogonal Planes) operator were combined to make supplement for describing most region details of the faces. The random forest classifier was selected, and experimental results show that the two features have a very good complementary, in the CASMEII database. The method is able to identify five types of emotion, the accuracy is promoted from 40. 50% to 64. 46%, and the category discrimination is improved accordingly.

Key words: micro-expression, optical flow, local binary patterns from three orthogonal planes(LBP-TOP);
random forest

中图分类号: 

  • TP391. 4