基于前馈卷积神经网络的多模块自监督降噪模型

doi:10.13229/j.cnki.jdxbgxb.20250138

Abstract

Abstract:

In order to solve the problem that pairwise noisy images and clean images are difficult to obtain in the process of denoising， this paper proposes a multi-modular self-supervised image denoising network based on feed-forward convolutional neural network（MMS-DNet）. The algorithm uses the improved DnCNN architecture. By adding a multivariate input module that combines original image down-sampling and global noise level estimation， multiple input sub-images are generated while compensating for the information loss in the generation process. The introduction of redundant information in the image reconstruction process is avoided by adding a sub-pixel convolution module. Experimental results show that the network outperforms existing self-supervised learning algorithms on the BSD68 and Set12 datasets of intensity images， and also achieves good results on CBSD68 and Kodak24 datasets of color images.

Key words: image denoising, feed-forward neural network, self-supervised, multi-modular

CLC Number:

TP751

Xiao-xin GUO,Guang-yu LI,Guang-qi YANG. Multi-modular self-supervised image denoising network based on feed-forward convolutional neural network[J].Journal of Jilin University(Engineering and Technology Edition), 2026, 56(9): 2467-2475.

Figures/Tables 16

Fig.1

Fig.2

Fig.3

Table 1

Fig.4

Table 2

Different noise level comparison on BSD68 dataset"

方法	$σ$ =15	$σ$ =25	$σ$ =50
方法	PSNR/SSIM	PSNR/SSIM	PSNR/SSIM
BM3D	31.07/0.82	28.57/0.80	25.62/0.69
WNNM	31.37/0.82	28.83/0.81	25.87/0.70
DnCNN	31.72/0.83	29.23/0.83	26.23/0.72
N2N	30.89/0.85	28.86/0.82	25.77/0.70
Blind2Unblind	31.44/0.89	28.99/0.82	26.09/0.72
SwinIA	31.07/0.86	29.17/0.80	26.61/0.71
MMS-DNet	31.66/0.87	29.28/0.82	26.30/0.72

Table 2

Fig.5

Table 3

Different noise level comparison on Set12 dataset"

方法	$σ$ =15	$σ$ =25	$σ$ =50
方法	PSNR/SSIM	PSNR/SSIM	PSNR/SSIM
BM3D	32.37/0.87	29.97/0.85	26.72/0.77
WNNM	32.70/0.85	30.26/0.86	27.05/0.78
DnCNN	32.86/0.91	30.43/0.87	27.18/0.78
N2N	32.60/0.90	30.02/0.85	26.83/0.77
Blind2Unblind	32.46/0.90	30.09/0.85	26.01/0.78
SwinIA	30.37/0.86	28.72/0.82	26.03/0.74
MMS-DNet	32.75/0.89	30.47/0.88	27.41/0.79

Table 3

Fig.6

Table 4

Different noise level comparison on CBSD68 dataset"

方法	$σ$ =15	$σ$ =25	$σ$ =50
方法	PSNR/SSIM	PSNR/SSIM	PSNR/SSIM
BM3D	33.52/0.93	30.71/0.86	27.38/0.79
WNNM	33.67/0.93	31.02/0.87	27.79/0.79
DnCNN	33.89/0.93	31.23/0.88	27.92/0.79
N2N	-/-	30.79/0.87	-/-
Blind2Unblind	33.67/0.92	30.86/0/86	27.88/0.78
SwinIA	33.45/0.91	28.40/0.79	27.34/0.72
MMS-DNet	33.87/0.93	31.21/0.88	27.95/0.79

Table 4

Fig.7

Table 5

Different noise level comparison on Kodak24 dataset"

方法	$σ$ =15	$σ$ =25	$σ$ =50
方法	PSNR/SSIM	PSNR/SSIM	PSNR/SSIM
BM3D	34.28/0.92	31.68/0.87	28.46/0.78
WNNM	34.35/0.92	32.00/0.88	28.74/0.79
DnCNN	34.48/0.92	32.03/0.88	28.85/0.80
N2N	-/-	32.08/0.88	-/-
Blind2Unblind	34.12/0.90	32.27/0.88	28.92/0.81
SwinIA	33.50/0.87	30.12/0.82	28.33/0.75
MMS-DNet	34.62/0.92	32.11/0.88	29.00/0.80

Table 5

Fig.8

Table 6

Table 7

Ablation experiment with different backbone"

主体网络	$σ$ =15	$σ$ =25	$σ$ =50
DnCNN	31.66	29.28	26.30
U-Net	30.79	28.99	26.16
VDSR	30.77	28.64	26.12

Table 7

Fig.9

References 24

[1]	Su J, Xu B, Yin H. A survey of deep learning approaches to image restoration[J]. Neurocomputing, 2022, 487: 46-65.
[2]	Liu D, Wen B X, Liu X M, et al. When image denoising meets high-level vision tasks: A deep learning approach[C]∥Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, Stockholm, Sweden, 2018: 842-848.
[3]	Tomasi C, Manduchi R. Bilateral filtering for gray and color images[C]∥Proceedings of Sixth International Conference on Computer Vision, Bombay, India, 1998: 839-846.
[4]	Gu S H, Zhang L, Zuo W M, et al. Weighted nuclear norm minimization with application to image denoising[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, USA, 2014: 2862-2869.
[5]	Buades A, Coll B, Morel J M. A non-local algorithm for image denoising[C]∥2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, USA, 2005: 60-65.
[6]	Dabov K, Foi A, Katkovnik V, et al. Image denoising by sparse 3-D transform-domain collaborative filtering[J]. IEEE Transactions on Image Processing, 2007, 16(8): 2080-2095.
[7]	Zhang K, Zuo W M, Gu S H, et al. Learning deep CNN denoiser prior for image restoration[C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, USA, 2017: 2808-2817.
[8]	Valsesia D, Fracastoro G, Magli E. Deep graph-convolutional image denoising[J]. IEEE Transactions on Image Processing, 2020, 29: 8226-8237.
[9]	Lehtinen J, Munkberg J, Hasselgren J, et al. Noise2Noise: learning image restoration without clean data[C]∥Proceedings of International Conference on Machine Learning, Stockholm, USA, 2018: 2965-2974.
[10]	Goodfellow I, Pougetabadie J, Mirza M, et al. Generative adversarial networks[J]. Communications of the ACM, 2020, 63(11): 139-144.
[11]	Chen J W, Chen J W, Chao H Y, et al. Image blind denoising with generative adversarial network based noise modeling[C]∥2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, USA, 2018: 3155-3164.
[12]	Chen H T, Wang Y H, Guo T Y, et al. Pre-trained image processing Transformer[C]∥2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, USA,2021:12294-12305.
[13]	Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need[J]. Advances in Neural Information Processing Systems, 2017, 30: 5998-6008.
[14]	Deng J, Dong W, Socher R, et al. ImageNet: A large-scale hierarchical image database[C]∥2009 IEEE Conferenceon Computer Vision and Pattern Recognition, Miami, USA,2009: 248-255.
[15]	Pang T Y, Zheng H, Quan Y H, et al. Recorrupted-to-recorrupted: Unsupervised deep learning for image denoising[C]∥Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, USA,2021: 2043-2052.
[16]	Martin D, Fowlkes C, Tal D, et al. A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics[C]∥Proceedings Eighth IEEE International Conference on Computer Vision, Vancouver, Canada, 2001: 416-423.
[17]	Zhang K, Zuo W M, Chen Y J, et al. Beyond a gaussian denoiser: residual learning of deep CNN for image denoising[J]. IEEE Transactions on Image Processing, 2017, 26: 3142-3155,
[18]	Franzen R. Kodak lossless true color image suite[EB/OL]. [2026-08-23].
[19]	Huynh-Thu Q, Ghanbari M. Scope of validity of PSNR in image/video quality assessment[J]. Electronics Letters, 2008, 44(13): 800-801.
[20]	Wang Z, Bovik A C, Sheikh H R, et al. Image quality assessment: from error visibility to structural similarity[J]. IEEE Transactions on Image Processing, 2004, 13(4): 600-612.
[21]	Zhang K, Zuo W M, Zhang L. FFDNet: toward a fast and flexible solution for CNN-based image denoising[J]. IEEE Transactions on Image Processing, 2018, 27(9): 4608-4622.
[22]	Gu S H, Zhang L, Zuo W M, et al. Weighted nuclear norm minimization with application to image denoising[C]∥IEEE Conference on Computer Vision and Pattern Recognition, Columbus, USA,2014: 2862-2869.
[23]	Wang Z J, Liu J Z, Li G Q, et al. Blind2unblind: Self-supervised image denoising with visible blind spots[C]∥Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, USA,2022: 2017-2026.
[24]	Mikhail P, Chizhov P, Parts L. SwinIA: self-supervised blind-spot image denoising with zero convolutions[C]∥2025 IEEE/CVF Winter Conference on Applications of Computer Vision, Tucson, Arizona, USA,2023: 7071-7080.

Related Articles 12

[1]	Di-ren LIU,Ao MA. Low contrast image denoising algorithm based on non local self similarity [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(7): 2378-2382.
[2]	Jing TIAN,She-qiang MA,Dan ZHAO,Fa-cheng CHEN. Vehicle travel speed estimation based on self⁃supervised long short⁃term memory network under single global navigation satellite system signal [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(12): 3852-3861.
[3]	Zi-tong WANG,Jing ZHAO,Shuang QIAO,Rui ZHU. Adaptive edge information image denoising model based on multi-directional gradient network [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(10): 3319-3328.
[4]	Jin-zhou ZHANG,Shi-qing JI,Chuang TAN. Fusion algorithm of convolution neural network and bilateral filtering for seam extraction [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(8): 2313-2318.
[5]	Xin-gang GUO,Ying-chen HE,Chao CHENG. Noise-resistant multistep image super resolution network [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(7): 2063-2071.
[6]	Lin BAI,Lin-jun LIU,Xuan-ang LI,Sha WU,Ru-qing LIU. Depth estimation algorithm of monocular image based on self-supervised learning [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(4): 1139-1145.
[7]	Li-bo CHENG,Xin-yue LI,Zhe LI,Xiao-ning JIA. Remote sensing image denoising method based on curvelet transform and goodness-of-fit test [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(11): 3207-3213.
[8]	Hong-wei ZHAO,Jian-rong ZHANG,Jun-ping ZHU,Hai LI. Image classification framework based on contrastive self⁃supervised learning [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(8): 1850-1856.
[9]	Da-ke ZHOU,Chao ZHANG,Xin YANG. Self-supervised 3D face reconstruction based on multi-scale feature fusion and dual attention mechanism [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(10): 2428-2437.
[10]	JIANG Chao, GENG Ze-xun, LIU Li-yong, PAN Ying-feng. Maximum likelihood image restoration combined with image denoising [J]. 吉林大学学报(工学版), 2015, 45(4): 1360-1366.
[11]	ZHANG Tian, SUN Yan-kui, TIAN Xiao-lin. Optical coherence tomography image denoising method by merging dyadic wavelet and anisotropic diffusion filter [J]. 吉林大学学报(工学版), 2013, 43(增刊1): 340-344.
[12]	Cui Yan-qiu；Wang Ke；Sun Wei. Image denoising method based on adaptive Gaussian mixture model in wavelet domain [J]. 吉林大学学报(工学版), 2006, 36(06): 983-0988.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

Comments

Recommended 0

No Suggested Reading articles found!

项目	网络层数	通道数	噪声范围	子图大小
灰度图	14	64	［15，50］	70×70
彩色图	12	96	［15，50］	50×50

实验序号	架构模块	PSNR/dB
1	DnCNN	29.23
2	DnCNN+池化下采样 +反池化	29.19
3	DnCNN+多元输入模块+反池化	29.25
4	DnCNN+池化下采样+子像素卷积	29.24
5	DnCNN+多元输入模块+子像素卷积	29.28

Multi-modular self-supervised image denoising network based on feed-forward convolutional neural network

RICH HTML

PDF (PC)