Journal of Jilin University(Engineering and Technology Edition) ›› 2025, Vol. 55 ›› Issue (5): 1728-1734.doi: 10.13229/j.cnki.jdxbgxb.20240446

Previous Articles     Next Articles

A facial subtle feature recognition algorithm considering the correlation between learning interests and micro expressions

Hong XIAO(),Xian-de LIU   

  1. School of Computer and Information Technology,Northeast Petroleum University,Daqing 163318,China
  • Received:2024-04-25 Online:2025-05-01 Published:2025-07-18

Abstract:

In order to improve the accuracy of facial fine feature recognition, a facial fine feature recognition algorithm considering the correlation between learning interests and micro expressions is proposed. Selecting image entropy as the objective function for facial image segmentation, using particle swarm optimization (PSO) algorithm to optimize the parameters of pulse coupled neural network (PCNN), determining the optimal values of key parameters, achieving facial image segmentation, and identifying key areas such as eyes and mouth. On the basis of analyzing the correlation between learning interests and micro expressions, the Harris algorithm is used to filter the scale invariant feature transform (SIFT) feature points, accurately locking the key interest points in facial expression images. A strategy based on the maximum coverage area and its adjacent range of feature points to capture the features of each region. The filtered area is used as input for local binary patterns (LBP) feature extraction, and facial fine feature recognition is achieved through support vector machine (SVM) multi classification technology. The experimental results show that the proposed algorithm performs well in facial image segmentation and has high accuracy in recognizing subtle facial features.

Key words: learning interests, microexpressions, relevance, fine facial features, recognition

CLC Number: 

  • TP391.4

Fig.1

PSO algorithm operation flowchart"

Table 1

Experimental Parameter Settings"

算法参数数值
粒子群算法迭代次数/次200
学习因子0.2
惯性权重0.1
粒子数量100
脉冲耦合神经网络连接权重0.3
阈值0.1
激活函数0.2
学习率0.1
调制参数0.5

Fig.2

Test sample image"

Table 2

Comparison of facial image segmentation performance tests using different algorithms"

测试样本编号测试指标本文算法传统图像分割算法
01OR0.020 20.125 0
UR0.051 70.770 1
ER0.162 40.218 2
02OR0.010 50.134 4
UR0.042 30.172 5
ER0.020 40.150 3
03OR0.009 90.122 3
UR0.041 90.078 8
ER0.016 30.125 0
04OR0.023 60.148 2
UR0.010 10.243 4
ER0.017 80.301 3

Fig.3

Comparison of subtle facial feature recognition results using different algorithms"

[1] 韩笑, 韩剑. 基于融合分层视觉感知的人脸局部特征识别[J]. 计算机仿真, 2022, 39(7):1 84-188.
Han Xiao, Han Jian. Face local feature recognition based on fusion hierarchical visual perception[J]. Computer Simulation, 2022, 39(7): 184-188.
[2] 兰凌强, 刘淇缘, 卢树华. 基于注意力机制与特征相关性的人脸表情识别[J]. 北京航空航天大学学报,2022, 48(1): 147-155.
Lan Ling-qiang, Liu Qi-yuan, Lu Shu-hua. Facial expression recognition based on attention mechanism and feature correlation[J]. Journal of Beijing University of Aeronautics and Astronautics, 2022, 48 (1): 147-155.
[3] 周丽芳, 刘俊林, 李伟生, 等. 深度二值卷积网络的人脸表情识别方法[J]. 计算机辅助设计与图形学学报, 2022, 34(3): 425-436.
Zhou Li-fang, Liu Jun-lin, Li Wei-sheng, et al. Facial expression recognition based on deep binary convolutional network[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(3): 425-436.
[4] 王军杰, 王泉, 蒋平, 等. 一种孤立中心损失方法及其在人脸表情识别中的应用[J]. 西安交通大学学报, 2022, 56(4): 119-126.
Wang Jun-jie, Wang Quan, Jiang Ping, et al.An isolated central loss method applied in facial expression recognition[J]. Journal of Xi'an Jiaotong University, 2022, 56(4): 119-126.
[5] 周天绮, 徐胜超. 基于广义对称变换的多模态人脸面部特征识别方法[J]. 计算机工程与设计, 2022, 43(9): 2609-2613.
Zhou Tian-qi, Xu Sheng-chao.Multimodal face feature recognition method based on generalized symmetric transformation[J]. Computer Engineering and Design, 2022, 43(9): 2609-2613.
[6] 姚树婧, 张立言, 李星燃. 结合特征解耦和静动态联合图卷积网络的人脸属性识别[J]. 计算机辅助设计与图形学学报, 2022, 34(7): 1020-1027.
Yao Shu-jing, Zhang Li-yan, Li Xing-ran. Facial attributes recognition combined with feature decoupling and static-dynamic joint graph convolutional network[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(7): 1020-1027.
[7] 陈拓, 邢帅, 杨文武, 等. 融合时空域特征的人脸表情识别[J]. 中国图象图形学报, 2022, 27(7): 2185-2198.
Chen Tuo, Xing Shuai, Yang Wen-wu, et al. Spatio-temporal features based human facial expression recognition[J]. Journal of Image and Graphics, 2022, 27(7): 2185-2198.
[8] Wu Y, Zhang L, Gu Z, et al. Edge-AI-driven framework with efficient mobile network design for facial expression recognition[J]. ACM Transactions on Embedded Computing Systems, 2023, 22(3): 1-17.
[9] 杨贞, 彭小宝, 朱强强, 等. 基于Deeplab V3 Plus的自适应注意力机制图像分割算法[J]. 计算机应用,2022, 42(1): 230-238.
Yang Zhen, Peng Xiao-bao, Zhu Qiang-qiang, et al. Image segmentation algorithm with adaptive attention mechanism based on Deeplab V3 Plus[J]. Journal of Computer Applications, 2022, 42(1): 230-238.
[10] 王小鹏, 魏统艺, 房超, 等.自适应非局部空间约束与K-L信息的模糊C-均值噪声图像分割算法[J]. 控制理论与应用, 2022, 39(7): 1261-1271.
Wang Xiao-peng, Wei Tong-yi, Fang Chao, et al. Fuzzy C-means algorithm with adaptive non-local spatial constraints and K-L information for noisy image segmentation[J]. Control Theory & Applications, 2022, 39(7): 1261-1271.
[11] 王力, 贾欣雨. 基于PSO-PF-SVM的模拟电路故障诊断[J]. 江苏大学学报:自然科学版, 2023, 44(2): 221-228.
Wang Li, Jia Xin-yu. Fault diagnosis of simulation circuit based on PSO-PF-SVM[J]. Journal of Jiangsu University(Natural Science Edition), 2023, 44(2): 221-228.
[12] Diao Z, Ueda K, Hou L, et al. Automatic drift compensation for nanoscale imaging using feature point matching[J]. Applied Physics Letters, 2023, 122(12): 121601.
[13] Lin C F, Su C W, Chen C S.Image capturing and stitching system based on scale-invariant feature transform features for untextured and smooth objects[J].Optical Engineering, 2023(11): 113103.
[14] 崔巍, 吴一梦, 曹福凯. 飞机主体合金裂缝的工业CT图像特征提取[J]. 兵器材料科学与工程, 2022,45(4): 115-119.
Cui Wei, Wu Yi-meng, Cao Fu-kai. Feature extraction of cracks in aircraft main body alloy from industrial CT image[J]. Ordnance Material Science and Engineering, 2022, 45(4): 115-119.
[15] Yılmaz A, Küçüker A, Bayrak G, et al. An improved automated PQD classification method for distributed generators with hybrid SVM-based approach using un-decimated wavelet transform[J]. International Journal of Electrical Power & Energy Systems, 2022, 136: 107763.
[1] Yan-fei LI,Jia-ning WU. Human pose local feature recognition algorithm based on improved RBF neural network [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(5): 1749-1755.
[2] Wei-zhi NIE,Fei YIN,Yi-shan SU. Review of taskdriven imaging sonar for underwater target recognition approaches [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(4): 1163-1175.
[3] Hong-bo ZOU,Qi-long LI. Laser weld image classification based on improved Northern Goshawk optimization algorithm [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(4): 1426-1435.
[4] Lin LIU,Yan-jun REN,Tong SHEN,Guo-dong YIN,You-jing ZHANG. Electric vehicle ramp recognition based on fusion of vehicle mass estimation [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(3): 846-856.
[5] Yi CAO,Yu XIA,Qing-yuan GAO,Pei-tao YE,Fan YE. Skeleton-based action recognition based on hyper-connected graph convolutional network [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(2): 731-740.
[6] Li LI,Yu-jian BAO,Wen-chen YANG,Qing-ling CHU,Gui-ping WANG. Standardized constructing method of a roadside multi-source sensing dataset [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(2): 529-536.
[7] Hua-zhen FANG,Li LIU,Qing GU,Xiao-feng XIAO,Yu MENG. Driving intention recognition based on trajectory prediction and extreme gradient boosting [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(2): 623-630.
[8] Hong-yu HU,Zheng-guang ZHANG,You QU,Mu-yu CAI,Fei GAO,Zhen-hai GAO. Driver behavior recognition method based on dual-branch and deformable convolutional neural networks [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(1): 93-104.
[9] Hao WANG,Bin ZHAO,Guo-hua LIU. Temporal and motion enhancement for video action recognition [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(1): 339-346.
[10] Lei ZHANG,Jing JIAO,Bo-xin LI,Yan-jie ZHOU. Large capacity semi structured data extraction algorithm combining machine learning and deep learning [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(9): 2631-2637.
[11] Xin-gang GUO,Chao CHENG,Zi-qi SHEN. Face expression recognition based on attention mechanism of convolution network [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(8): 2319-2328.
[12] Sheng-jie ZHU,Xuan WANG,Fang XU,Jia-qi PENG,Yuan-chao WANG. Multi-scale normalized detection method for airborne wide-area remote sensing images [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(8): 2329-2337.
[13] Li LI,Xiao-qiang WU,Wen-chen YANG,Rui-jie ZHOU,Gui-ping WANG. Target recognition and tracking of group vehicles based on roadside millimeter-wave radar [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(7): 2104-2114.
[14] Xin-dong YOU,Lei GUO,Jing HAN,Xue-qiang LYU. An character recognition network for imprint character [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(7): 2072-2079.
[15] Yi CAO,Ping LI,Wei-guan WU,Yu XIA,Qing-yuan GAO. Voiceprint recognition method based on novel loss function DV-Softmax [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(11): 3318-3326.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] Xu Guan, Su Jian, Chen Rong, Zhang Li-bin, Su Li-li . Error analysis of measurement model and calibration method for automobile caster[J]. 吉林大学学报(工学版), 2008, 38(01): 17 -020 .
[2] Meng Fan-zhong;Cheng Ya-bing;Li Ya-nan . Fatigue lifetime distribution pattern of automotive chain[J]. 吉林大学学报(工学版), 2006, 36(06): 889 -0892 .
[3] SHI Gang,SHI Yong-jiu,WANG Yuan-qing . Analysis on overall buckling behaviour of ultra-high strength steel columns by ANSYS[J]. 吉林大学学报(工学版), 2009, 39(01): 113 -118 .
[4] ZHANG Shu-shan, GAO Da-xin|WANG Tao|WANG Li. Research on the design, simulation and optimization of logistics services ability based on |dynamic quality function deployment[J]. 吉林大学学报(工学版), 2009, 39(增刊2): 204 -0208 .
[5] DING Ying,LI Wen-hui,FAN Jing-tao,YANG Hua-min. Real-time calibration algorithm of distortion of wide-field view based on GPU[J]. 吉林大学学报(工学版), 2010, 40(01): 189 -0194 .
[6] GUO Wei-Liang, SONG Jia, LIU Yan, ZHANG Xin-Yan, GUO You-Ming, MENG Qing-Fan, LU Jia-Hui, TENG Li-Rong, LI Shan-Shan. Application of near infrared spectroscopyradial basis function neural network in realtime monitoring nisin titer and cell concentration[J]. 吉林大学学报(工学版), 2010, 40(增刊): 416 -0420 .
[7] MU De-qiang, CHEN Su-huan . Analysis on the Dynamic Behaviour of Drill Bit in Cutting[J]. 吉林大学学报(工学版), 2000, 30(01): 48 -52 .
[8] ZHANG Yang, LIU Xin-hui. Yaw stability for steering motion of articulated vehicle[J]. 吉林大学学报(工学版), 2012, 42(02): 266 -271 .
[9] DOU Quan-sheng, PAN Guan-yu, LIU Yan, ZHOU Chun-guang, SHI Zhong-zhi. Vector correction and jump out of local optimum strategy for PSO[J]. 吉林大学学报(工学版), 2012, 42(02): 429 -433 .
[10] GUO Lie, HUANG Xiao-hui, GE Ping-shu, ZHANG Guang-xi, YUE Ming. Lane changing trajectory tracking control for intelligent vehicle on curved road based on backstepping[J]. 吉林大学学报(工学版), 2013, 43(02): 323 -328 .