facial makeup transfer, generate antagonistic network, image style transfer, loss function, generator, discriminator ,"/> 基于生成对抗网络的人脸妆容自动迁移方法

吉林大学学报(信息科学版) ›› 2022, Vol. 40 ›› Issue (3): 479-487.

• • 上一篇    下一篇

基于生成对抗网络的人脸妆容自动迁移方法

颜文胜1 , 吕红兵2   

  1. 1. 台州职业技术学院 信息技术工程学院, 浙江 台州 318000; 2. 浙江大学 计算机科学与技术学院, 杭州 310027
  • 收稿日期:2021-07-20 出版日期:2022-07-14 发布日期:2022-07-15
  • 作者简介:颜文胜(1972— ), 男, 浙江台州人, 台州职业技术学院副教授, 硕士, 主要从事图形图像、 人工智能研究, ( Tel)86- 13566813366(E-mail)yanws@ tzvtc. edu. cn; 吕红兵(1966— ), 男, 杭州人, 浙江大学副教授, 主要从事大数据、 机器学习 以及智能控制研究, (Tel)86-13605716202(E-mail)lhb@ zju. edu. cn。
  • 基金资助:
    浙江省高等教育十三五冶教学改革研究基金资助项目(jg20190884); 浙江省教育厅科研基金资助项目(Y202044737)

Automatic Face Makeup Transfer Method Based on Generative Adversarial Network

YAN Wensheng1 , Lü Hongbing2   

  1. 1. School of Information Technology Engineering, Taizhou Vocationaland Technical College, Taizhou 318000, China; 2. College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
  • Received:2021-07-20 Online:2022-07-14 Published:2022-07-15

摘要: 为有效解决现有人脸妆容迁移方法训练数据缺乏, 以及上妆区域错误等问题, 提出了一种基于生成对抗 网络的人脸妆容自动迁移方法。 方法通过构建生成对抗网络目标函数, 采用 Encoder-Decoder 神经网络生成对抗网络生成器, 并基于多层卷积神经网络构建鉴别器, 训练算法采用交替优化的方式。 仿真实验和方法比对结果表明, 该方法在保持素颜妆后图像脸部结构不变的同时, 尽可能地体现了参考妆容风格, 得到了更协调的上妆效果, 具有更佳的对比优势和视觉效果, 为人脸妆容自动迁移技术提供了新思路。

关键词: 人脸妆容迁移, 生成对抗网络, 图像风格迁移, 损失函数, 生成器, 鉴别器 

Abstract: In order to further solve the problems such as lack of training data and the wrong makeup area in the existing facial makeup transfer methods, an automatic face makeup migration method based on the generation countermeasure network is proposed. This method constructs the objective function of generative adversarial networks, and achieves the generator by encoder-decoder neural network. Meanwhile, it constructs the discriminator based on multilayer convolutional neural network. The training algorithm adopts alternating optimization. The results of simulation experiment and method comparison show that this method keeps the facial structure, and reflects the reference makeup style as much as possible, achieves a more harmonious makeup effect, has better comparative advantages and visual effects, and provides a new idea for the automatic facial makeup transfer technology.

Key words: facial makeup transfer')">

facial makeup transfer, generate antagonistic network, image style transfer, loss function, generator, discriminator

中图分类号: 

  • TP391