吉林大学学报(理学版) ›› 2025, Vol. 63 ›› Issue (3): 804-0814.

• • 上一篇    下一篇

基于数据增强循环生成对抗网络的图像水墨画风格迁移方法

李伟伟1, 傅博2, 王贺霏2, 孙文燕1, 薛玉利1   

  1. 1. 山东青年政治学院 信息工程学院, 济南 250103;2. 辽宁师范大学 计算机与人工智能学院, 辽宁 大连 116081
  • 收稿日期:2023-11-13 出版日期:2025-05-26 发布日期:2025-05-26
  • 通讯作者: 傅博 E-mail:fubo@lnnu.edu.cn

Style Transfer Method of Image Ink Painting Based on Data Enhanced CycleGAN

LI Weiwei1, FU Bo2, WANG Hefei2, SUN Wenyan1, XUE Yuli1   

  1. 1. School of Information Engineering, Shandong Youth University of Political Science, Jinan 250103, China;2. School of Compu
    ter Science and Artificial Intelligence, Liaoning Normal University, Dalian 116081, Liaoning Province, China
  • Received:2023-11-13 Online:2025-05-26 Published:2025-05-26

摘要: 针对现有图像水墨画风格迁移效果欠佳的问题, 提出一种新的基于数据增强的循环生成对抗网络(GAN), 用于非配对的自然风景照片水墨画风格迁移. 首先, 设计双生成器-判别器结构有效提高单向GAN模型的映射约束; 其次, 使用多种损失函数优化模型, 引入总变分损失和恒等映射损失, 并结合多尺度结构相似性设计新的循环一致性损失函数, 以更好地捕捉传统水墨画的特征; 最后, 使用数据增强技术增加真实数据和生成数据的数量和多样性以提高生成器性能. 对比实验结果表明, 该方法可有效地将自然风景照片迁移为传统水墨画风格图像.

关键词: 循环生成对抗网络, 图像水墨画风格迁移, 损失函数, 数据增强

Abstract: Aiming at  the problem of poor effect of the style transfer of existing image ink painting, we proposed a new data enhanced cycle generative adversarial network (GAN) for the style transfer of ink painting of unpaired natural landscape photos. Firstly, the binary synthesizer and discriminator structure was designed to effectively improve the mapping constraints of one-way GAN models. Secondly, we used multiple loss functions to optimize the model, introduced total variational loss and identity mapping loss, and designed a new cyclic consistency loss function combined with multi-scale structural similarity to better capture the characteristics of traditional ink painting. Finally, data enhancement techniques were used to increase the amount and variety of real and generated data to improve generator performance. The comparative experimental results show that this method can effectively transfer natural landscape images to traditional ink painting style images.

Key words:  , CycleGAN, style transfer of image ink painting, loss function, data enhancement

中图分类号: 

  • TP391.4