Journal of Jilin University(Engineering and Technology Edition) ›› 2023, Vol. 53 ›› Issue (10): 2973-2981.doi: 10.13229/j.cnki.jdxbgxb.20211386

Previous Articles     Next Articles

Integrated LSTM and ARIMA method based on attention model for soil temperature

Qing-tian GENG1(),Yang ZHAO1,Qing-liang LI1(),Fan-hua YU2,Xiao-ning LI1   

  1. 1.College of Computer Science and Technology,Changchun Normal University,Changchun 130032,China
    2.College of Computer Science and Technology,Beihua University,Jilin 132013,China
  • Received:2021-12-16 Online:2023-10-01 Published:2023-12-13
  • Contact: Qing-liang LI E-mail:qtgeng@mail.ccsfu.edu.cn;lliqingliang@ccsfu.edu.cn

Abstract:

In order to accurately analyze the problem of soil temperature characteristics, this paper proposes a prediction model based on attention mechanism of multi-channel long and short-term memory network fused with ARIMA algorithm. The attention-based multi-channel long- and short-term memory network is used to extract important temporal features at different moments of the long and short term, and the ARIMA time series model is used to extract linear features to take advantage of predicting soil temperature more accurately. To validate the proposed model, four evaluation metrics, root mean square error, mean absolute error, mean square error and coefficient of determination, were tested at two weather stations in Switzerland (Laegern and Fluehli weather stations) for the next 6, 12 and 24 hours, while soil depths on 5, 10 and 15 cm soil temperatures. Compared with thse autoregressive integrated moving average model, the long and short-term memory network and the fully connected network, the proposed model has the optimal performance, especially the most significant improvement in the soil temperature model for Fluehli station (10 cm soil depth) during the next 6 hours; the highest relative coefficient of determination value of 0.9965, the lowest root mean square error of 0.3414, the average absolute error of 0.2310 and mean squared error of 0.1165.Therefore, the proposed model can be used as an alternative alternative method for soil temperature estimation.

Key words: machine learning, neural network, soil temperature modeling, attention model, long short-term memory

CLC Number: 

  • TP391

Fig.1

Framework for soil temperature"

Fig.2

Structure of an LSTM"

Fig.3

AT-MC-LSTM model"

Fig.4

Location and geographical information of experimental station"

Table 1

The best ARIMA (p, d, q) model of each test scenario"

测试场景最优的ARIMA模型
1(Laegern站的5 cm深度)ARIMA(3, 1, 0)
2(Laegern站的10 cm深度)ARIMA(2, 1, 0)
3(Laegern站的15 cm深度)ARIMA(0, 2, 2)
4(Fluehli 站的5 cm深度)ARIMA(4, 1, 0)
5(Fluehli 站的10 cm深度)ARIMA(1, 1, 0)
6(Fluehli 站的15 cm深度)ARIMA(1, 1, 2)

Table 2

Testing phase results of different model atLaegern station"

土壤深度评估时间方法RMSEMAEMSER2
5 cm6FCNN2.36431.81735.58980.8327
ARIMA1.35400.95031.83340.9505
LSTM1.20910.86541.46200.9605
MC-LSTM0.64140.43100.31650.9865
12FCNN2.43651.85595.93660.8216
ARIMA1.05790.73991.11920.9697
LSTM1.07860.76341.16340.9685
MC-LSTM0.69470.48550.35370.9855
24FCNN2.52061.89066.35360.8089
ARIMA1.41170.98601.99290.9460
LSTM1.30350.90741.69920.9539
MC-LSTM0.72300.51850.52270.9845
10 cm6FCNN1.36591.10221.86560.9314
ARIMA1.13450.80571.28700.9637
LSTM0.80470.62950.64760.9762
MC-LSTM0.52780.36020.27860.9921
12FCNN1.22760.88351.50700.9445
ARIMA0.93070.65160.86620.9755
LSTM0.80810.61240.65300.9760
MC-LSTM0.84420.57680.71270.9799
24FCNN1.34861.01141.81870.9329
ARIMA1.28360.88091.64750.9533
LSTM1.14000.87981.29950.9521
MC-LSTM0.92550.64700.85660.9757
15 cm6FCNN0.93420.83800.87270.9631
ARIMA0.76610.53830.58680.9826
LSTM0.57950.45130.33580.9858
MC-LSTM0.34140.23100.11650.9965
12FCNN0.88310.71370.77990.9669
ARIMA0.72440.51560.52470.9844
LSTM0.65100.51090.42380.9820
MC-LSTM0.59470.41550.35370.9895
24FCNN0.91140.68930.83070.9647
ARIMA0.91990.65790.84630.9748
LSTM0.89830.70630.80700.9657
MC-LSTM0.69730.49680.48620.9855

Fig.5

Scatterplots of estimated and observed values of temperature using predictive models for Laegern station"

1 Lai L M, Zhao X C, Jiang L H, et al., Soil respiration in different agricultural and natural ecosystems in an arid region[J]. PLoS One, 2012, 7(10): 1-9.
2 Kisi O, Sanikhani H. Modelling long-term monthly temperatures by several data-driven methods using geographical inputs[J]. International Journal of Climatology, 2015, 35(13): 3834-3846.
3 Bonakdari H, Moeeni H, Ebtehaj I, et al. New insights into soil temperature time series modeling: linear or nonlinear?[J]. Theoretical & Applied Climatology, 2019, 135(3/4): 1157-1177.
4 Zhang J, Yan Z, Zhang X, et al. Developing a long short-term memory (LSTM) based model for predicting water table depth in agricultural areas[J]. Journal of Hydrology, 2018, 561: 918-929.
5 Guo J, Xie Z, Qin Y, et al. Short-term abnormal passenger flow prediction based on the fusion of SVR and LSTM[J]. IEEE Access, 2019, 7: 42946-42955.
6 Xiang-yun Qing, Niu Y. Hourly day-ahead solar irradiance prediction using weather forecasts by LSTM[J]. Energy, 2018,148: 461-468.
7 Cheng J, Dong L, Lapata M. Long short-term memory-networks for machine reading[C]∥Proceedings of the Conference on Empirical Methods in Natural Language Processing, Austin, USA,2016.
8 Li Q, Hao H, Zhao Y, et al. GANs-LSTM model for soil temperature estimation from meteorological: a new approach[J]. IEEE Access, 2020, 8: 59427-59443.
9 Mehdizadeh S, Behmanesh J, Khalili K. Evaluating the performance of artificial intelligence methods for estimation of monthly mean soil temperature without using meteorological data[J]. Environmental Earth Sciences, 2017, 76(8): 325.
10 Srivastava N, Hinton G, Krizhevsky A, et al. Dropout: a simple way to prevent neural networks from overfitting[J]. Journal of Machine Learning Research, 2014, 15(1): 1929-1958.
11 Kingma D P, Ba J L. Adam: a method for stochastic optimization[C]//The 3rd International Conference on Learning Representations, San Diego, USA, 2015: 1-15.
[1] Shuang LI,Zi-rui LIN,Song YE,Xu LIU,Ji-song ZHAO. Orbital capability evaluation and trajectory reconstruction for launch vehicle with thrust decline [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(8): 2245-2253.
[2] Xiang-jiu CHE,Huan XU,Ming-yang PAN,Quan-le LIU. Two-stage learning algorithm for biomedical named entity recognition [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(8): 2380-2387.
[3] Qing-tian GENG,Zhi LIU,Qing-liang LI,Fan-hua YU,Xiao-ning LI. Prediction of soil moisture based on a deep learning model [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(8): 2430-2436.
[4] Feng LYU,Nian LI,Zhuang-zhuang FENG,Yang-hang ZHANG. Method of collaborative filtering recommendation of personalized product-service system based on user [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(7): 1935-1942.
[5] Peng-ju LIU. Design of automatic identification algorithm for Internet of Things security situation based on deep neural network [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(7): 2121-2126.
[6] Pei-yong LIU,Jie DONG,Luo-feng XIE,Yang-yang ZHU,Guo-fu YIN. Surface defect detection algorithm of magnetic tiles based on multi⁃branch convolutional neural network [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(5): 1449-1457.
[7] Zhen-hai ZHANG,Kun JI,Jian-wu DANG. Crack identification method for bridge based on BCEM model [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(5): 1418-1426.
[8] Yan-tao TIAN,Fu-qiang XU,Kai-ge WANG,Zi-xu HAO. Expected trajectory prediction of vehicle considering surrounding vehicle information [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 674-681.
[9] Ya-jing YU,Jian GUO,Rong-hao WANG,Wei QIN,Ming-wu SONG,Zheng-rong XIANG. Time⁃varying formation control of multiquadrotor unmanned aerial vehicles based on state observer [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 871-882.
[10] Shuai-shuai ZHANG,Yan-fang YIN,Lin-jing XIAO,Shuai JIANG. Static gait planning method for quadruped robot based on gate recurrent neural network [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 902-912.
[11] Rong-han YAO,Wen-tao XU,Wei-wei GUO. Drivers' takeover behavior and intention recognition based on factor and long short⁃term memory [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 758-771.
[12] Heng-yan PAN,Wen-hui ZHANG,Ting-ting LIANG,Zhi-peng PENG,Wei GAO,Yong-gang WANG. Inducement analysis of taxi drivers' traffic accidents based on MIMIC and machine learning [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(2): 457-467.
[13] Jin-Zhen Liu,Guo-Hui Gao,Hui Xiong. Multi⁃scale attention network for brain tissue segmentation [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(2): 576-583.
[14] Hui-zhen ZHANG,Zheng-kai GAO,Jian-qiang LI,Chen-xi WANG,Yu-biao PAN,Cheng WANG,Jing WANG. Short⁃term passenger flow forecasting of urban rail transit based on recurrent neural network [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(2): 430-438.
[15] Jian-cheng WENG,Rui-cong WEI,Han-mei HE,Hai-hui XU,Jing-jing WANG. Urban road network short-term traffic flow prediction model based on associated road chain group [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(11): 3104-3112.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!