Journal of Jilin University(Engineering and Technology Edition) ›› 2020, Vol. 50 ›› Issue (5): 1755-1764.doi: 10.13229/j.cnki.jdxbgxb20190554

Previous Articles    

Low⁃dose spectral computer⁃tomography imaging denoising method via a generative adversarial network

Zai-feng SHI1,2(),Jin-zhuo LI1,Qing-jie CAO3,Hui-long LI1,Qi-xing HU1   

  1. 1.School of Microelectronics, Tianjin University, Tianjin 300072,China
    2.Tianjin Key Laboratory of Imaging and Sensing Microelectronic Technology, Tianjin 300072,China
    3.School of Mathematical Sciences, Tianjin Normal University, Tianjin 300387,China
  • Received:2019-06-03 Online:2020-09-01 Published:2020-09-16

Abstract:

The continuous development and widespread use of computed tomography(CT) in medical practice have caused patients and doctors’ attention to the risk of cancer due to radiation dose. However, spectral CT can generate severe Poisson noise as a result of the division of multiple energy bins while reducing the radiation dose, which has an adverse effect on clinical diagnosis. Aiming at improving the reconstructed image quality of spectral CT under low radiation dose, a denoising model based on a generative adversarial network with the hybrid perceptual loss was proposed. The method combines pixel space with the human-perceived feature space into generative adversarial network, and introduces the residual learning to reuse features from different levels to avoid the loss of important details that come from the increase in the number of network layers. Then the Wasserstein distance is chosen instead of Jensen-Shannon to improve the stability of training. The inputs are from multiple energy bins, so that the spatial correlation of the reconstructed image from a single energy bin and the energy correlation between different reconstructed images from multiple energy bins can be utilized to improve the visual sensitivity of low dose spectral CT images. The experiments were performed on the simulated phantom data sets from Duke University Medical Center. The results show that the proposed method increases the PSNR by about 5 dB, the structure similarity (SSIM) value by about 0.2, and the feature similarity (FSIM) value about by 0.06. Compared with current advanced low-dose CT denoising method, the hybrid loss function based generative and adversarial network achieves a better noise removal, while retaining the necessary details for diagnosis. Moreover, the spectral information also plays a positive role in the recovery of noise images, and the use of hybrid perceptual loss is superior to any single loss. Overall, the proposed generative adversarial network with a hybrid loss method can significantly improve the quality of low-dose spectral CT images.

Key words: information processing technology, low dose, generative adversarial network, residual learning

CLC Number: 

  • TP391.4

Fig.1

Low dose spectral CT denoising network framework"

Fig.2

Internal structure of generative adversarial network"

Fig.3

Comparison of denoising effects from different methods in image ①"

Fig.4

Comparison of denoising effects from different methods in image ②"

Table 1

Objective evaluation index of image ①②"

图像序号能量区间指标LDCTCNNWGAN-VGGHPWGAN-2DHPWGAN-3D
30~80 keVPSNR/dB32.62

36.94

(+4.32)

34.03

(+1.41)

35.54

(+2.92)

37.66

(+5.04)

SSIM0.7219

0.8888

(+0.1669)

0.8540

(+0.1321)

0.8683

(+0.1464)

0.8933

(+0.1714)

FSIM0.9098

0.9630

(+0.0532)

0.9427

(+0.0329)

0.9591

(+0.0493)

0.9744

(0.0646)

80~120 keVPSNR/dB33.15

37.94

(+4.79)

35.52

(+2.37)

36.79

(+3.64)

38.95

(+5.80)

SSIM0.7373

0.9158

(+0.1785)

0.9156

(+0.1783)

0.9157

(+0.1784)

0.9270

(+0.1897)

FSIM0.9132

0.9666

(+0.0534)

0.9500

(+0.0368)

0.9640

(+0.0508)

0.9793

(+0.0661)

30~80 keVPSNR/dB32.37

36.07

(+3.70)

33.25

(+0.88)

34.76

(+2.39)

37.09

(+4.72)

SSIM0.6929

0.8708

(+0.1779)

0.8209

(+0.1280)

0.8573

(+0.1644)

0.8810

(+0.1881)

FSIM0.9086

0.9604

(+0.0518)

0.9412

(+0.0326)

0.9565

(+0.0479)

0.9716

(+0.0630)

80~120 keVPSNR/dB32.88

37.76

(+4.88)

35.54

(+2.66)

36.82

(+3.94)

38.70

(+5.82)

SSIM0.7137

0.9085

(+0.1948)

0.9054

(+0.1917)

0.9070

(+0.1933)

0.9198

(+0.2061)

FSIM0.9134

0.9630

(+0.0496)

0.9486

(+0.0352)

0.9613

(+0.0479)

0.9753

(+0.0619)

Fig.5

Statistical average value of image assessment results from different algorithms on test sets"

Fig.6

Comparison of denoising effects from different loss functions"

Table 2

Comparison of average indicators from different loss functions on test sets"

能量区间指标MSE 损失纹理 损失感知 损失复合感知损失
30~80 keVPSNR/dB37.3935.6534.8037.41
SSIM0.81690.84670.79120.8919
FSIM0.97120.96330.94850.9738
80~120 keVPSNR/dB39.2437.4136.6138.70
SSIM0.92360.91040.90880.9255
FSIM0.97380.96910.95590.9774
1 Brenner D J, Hall E J. Computed tomography-an increasing source of radiation exposure[J]. New England Journal of Medicine, 2007, 357(22): 2277-2284.
2 de Gonzalez A B, Mahesh M, Kim K P, et al. Projected cancer risks from computed tomographic scans performed in the united states in 2007[J]. Archives of Internal Medicine, 2009, 169(22): 2071-2077.
3 Wang J, Li T F, Lu H B, et al. Penalized weighted least-squares approach to sinogram noise reduction and image reconstruction for lowdose X-ray computed tomography[J]. IEEE Transactions on Medical Imaging, 2006, 25(10): 1272-1283.
4 Beister M, Kolditz D, Kalender W A. Iterative reconstruction methods in X-ray CT[J]. Physica Medica, 2012, 28(2): 94-108.
5 Liu Y, Ma J H, Fan Y, et al. Adaptive-weighted total variation minimization for sparse data toward low-dose X-ray computed tomography image reconstruction[J]. Physics in Medicine & Biology, 2012, 57(23): 7923-7956.
6 Yang C, Yin X D, Shi L Y, et al. Improving abdomen tumor low-dose CT images using a fast dictionary learning based processing[J]. Physics in Medicine & Biology, 2013, 58(16): 5803-5820.
7 Fumene F P, Vinegoni C, Gros J, et al. Block matching 3D random noise filtering for absorption optical projection tomography[J]. Physics in Medicine & Biology, 2010, 55(18): 5401-5415.
8 郜峰利, 陶敏, 李雪妍, 等. 基于深度学习的CT影像脑卒中精准分割[J]. 吉林大学学报: 工学版, 2020, 50(2): 678-684.
Gao Feng-li, Tao Min, Li Xue-yan, et al. Accurate segmentation of stroke in CT image based on deep learning[J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(2): 678-684.
9 司建波, 杨芳, 郭蔚莹, 等. 基于BP神经网络的两阶段疾病预测模型[J]. 吉林大学学报: 工学版, 2013, 43(): 481-484.
Si Jian-bo, Yang Fang, Guo Wei-ying, et al. Two-stage disease prediction model based on BP neural network[J]. Journal of Jilin University(Engineering and Technology Edition), 2013, 43(Sup.1): 481-484.
10 Chen H, Zhang Y, Zhang W H, et al. Low-dose CT via convolutional neural network[J]. Biomedical Optics Express, 2017, 8(2): 679-694.
11 Wolterink J M, Leiner T, Viergever M A, et al. Generative adversarial networks for noise reduction in low-dose CT[J]. IEEE Transactions on Medical Imaging, 2017, 36(12): 2536-2545.
12 Yang Q S, Yan P K, Zhang Y B, et al. Low dose CT image denoising using a generative adversarial network with Wasserstein distance and perceptual loss[J]. IEEE Transactions on Medical Imaging, 2018, 37(6): 1348-1357.
13 Zhang Y B, Mou X Q, Wang G, et al. Tensor-based dictionary learning for spectral CT reconstruction[J]. IEEE Transactions on Medical Imaging, 2017, 36(1): 142-154.
14 Shi Z F, Yang H Y, Cong W X, et al. An edge-on charge-transfer design for energy-resolved X-ray detection[J]. Physics in Medicine and Biology, 2016, 61(11): 4183-4200.
[1] Wei ZHANG,Yong HAN,Ming JIN,Xiao-lin QIAO. Toeplitz matrices reconstruction based DOA estimation for coherent signals [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(2): 703-710.
[2] Yan-fen CHENG,Li-juan YAO,Qiao YUAN,Xian-qiao CHEN. Clearing strategy of underwater video image [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(2): 668-677.
[3] Xiao-hui YU,Zhi-cheng ZHANG,Xin-bo LI,Xiao-dong SUN. Parameter estimation of exponentially damped sinusoidsbased on state⁃space model [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 2083-2088.
[4] Fu LIU, Mei-jing QUAN, Ke WANG, Yun LIU, Bing KANG, Zhi-wu HAN, Tao HOU. Indoor positioning method based on location fingerprinting of imitating mechanism of scorpion vibration source [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 2076-2082.
[5] Zi-ji MA,Hao LU,Yan-ru DONG. Dual path convolutional neural network forsingle image super⁃resolution [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 2089-2097.
[6] Yang LU,Shi-gang WANG,Wen-ting ZHAO,Yan ZHAO. Facial expression recognition based on separability assessment of discrete Shearlet transform [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(5): 1715-1725.
[7] Chao DONG,Jing⁃hong LIU,Fang XU,Ren⁃hao WANG. Fast ship detection in optical remote sensing images [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(4): 1369-1376.
[8] Ke⁃yan WANG,Yan HU,Huai WANG,Yun⁃song LI. Image dehazing algorithm by sky segmentation and superpixel⁃level dark channel [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(4): 1377-1384.
[9] Lu⁃tao LIU,Na LI. Source detection based on coprime array [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(3): 986-993.
[10] Tohtonur,Hai⁃long ZHANG,Jie WANG,Na WANG,Xin⁃chen YE,Wan⁃qiong WANG. High speed median filtering algorithm based on graphics processing unit [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(3): 979-985.
[11] Yin⁃juan FU,Yong LI,Li⁃qin XU,Kun⁃hui ZHANG. Design and analysis of NLFM⁃Costas RF stealth radar signal [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(3): 994-999.
[12] YING Huan,LIU Song-hua,TANG Bo-wen,HAN Li-fang,ZHOU Liang. Efficient deterministic replay technique based on adaptive release strategy [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1917-1924.
[13] LIU Zhong-min,WANG Yang,LI Zhan-ming,HU Wen-jin. Image segmentation algorithm based on SLIC and fast nearest neighbor region merging [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1931-1937.
[14] SHAN Ze-biao,LIU Xiao-song,SHI Hong-wei,WANG Chun-yang,SHI Yao-wu. DOA tracking algorithm using dynamic compressed sensing [J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1938-1944.
[15] QUAN Wei, HAO Xiao-ming, SUN Ya-dong, BAI Bao-hua, WANG Yu-ting. Development of individual objective lens for head-mounted projective display based on optical system of actual human eye [J]. 吉林大学学报(工学版), 2018, 48(4): 1291-1297.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!