Deep Learning Approach Using the GRU-LSTM Hybrid Model for Air Temperature Prediction on Daily Basis

Authors

  • Yuslena Sari Doctoral Department of Agricultural Science, Universitas Lambung Mangkurat, INDONESIA
  • Yudi Firmanul Arifin Faculty of Forestry, Universitas Lambung Mangkurat, INDONESIA
  • Novitasari Novitasari Faculty of Engineering, Universitas Lambung Mangkurat, INDONESIA
  • Mohammad Reza Faisal Department of Information Technology, Universitas Lambung Mangkurat, INDONESIA

Keywords:

GRU, LSTM, performance, prediction, temperature

Abstract

Air temperature has a rapid change movement every day. Temperature prediction is very important as a proper reference base for decision making and good planning for stakeholders. However, in the time series daily temperature prediction, the right number of input combinations has not been found for high accuracy. To overcome this, we propose a deep learning approach using the Hybrid gated recurrent units (GRU) - long short-term memory (LSTM) model. These two deep learning models are very suitable for time series predictions. It has 2 (two) main advantages, namely: A variety of input scenarios is used to find the most reliable performance. (1) the model eliminates the time series decomposition process by embedding a time layer to achieve efficient predictions, and (2) the model achieves a stronger high-level temporal to produce reliable performance. Performance measurement uses root mean squared error (RMSE), mean absolute error (MAE), and R-Squared (R2). Best RMSE on 15-day input, which is 0.07499. The best result of MAE is with a value of 0.0578 at the input of 15 days. The performance results obtained both RMSE and MAE, the smallest of the 15 experimental scenarios is at the input of 15 days. The results of R2 are in line with the results of RMSE and MAE, namely the input in 15 days produces the best R2 close to 1, which is 0.9937.

Downloads

Download data is not yet available.

References

M. L. Lin, C. W. Tsai, and C. K. Chen, “Daily maximum temperature forecasting in changing climate using a hybrid of Multi-dimensional Complementary Ensemble Empirical Mode Decomposition and Radial Basis Function Neural Network,” J Hydrol Reg Stud, vol. 38, no. September, p. 100923, 2021, doi: 10.1016/j.ejrh.2021.100923.

M. Yu, F. Xu, W. Hu, J. Sun, and G. Cervone, “Using Long Short-Term Memory (LSTM) and Internet of Things (IoT) for Localized Surface Temperature Forecasting in an Urban Environment,” IEEE Access, vol. 9, pp. 137406–137418, 2021, doi: 10.1109/ACCESS.2021.3116809.

K. L. Akinwande, A. R. Arotiowa, and A. J. Ete, “Impacts of changes in temperature and exposure time on the median lethal concentrations (LC50) of a combination of organophosphate and pyrethroid in the control of Culex quinquefasciatus, say (Diptera: Culicidae),” Sci Afr, vol. 12, p. e00743, 2021, doi: 10.1016/j.sciaf.2021.e00743.

. Gill, D. R. . (2022). A Study of Framework of Behavioural Driven Development: Methodologies, Advantages, and Challenges. International Journal on Future Revolution in Computer Science &Amp; Communication Engineering, 8(2), 09–12. https://doi.org/10.17762/ijfrcsce.v8i2.2068

X. Bi et al., “Impacts of air temperature and its extremes on human mortality in Shanghai, China,” Urban Clim, vol. 41, no. June 2021, p. 101072, 2022, doi: 10.1016/j.uclim.2021.101072.

. Ananthakrishnan, B., V. . Padmaja, S. . Nayagi, and V. . M. “Deep Neural Network Based Anomaly Detection for Real Time Video Surveillance”. International Journal on Recent and Innovation Trends in Computing and Communication, vol. 10, no. 4, Apr. 2022, pp. 54-64, doi:10.17762/ijritcc.v10i4.5534.

D. Cho, C. Yoo, B. Son, J. Im, D. Yoon, and D. H. Cha, “A novel ensemble learning for post-processing of NWP Model’s next-day maximum air temperature forecast in summer using deep learning and statistical approaches,” Weather Clim Extrem, vol. 35, p. 100410, 2022, doi: 10.1016/j.wace.2022.100410.

Y. Sari, E. S. Wijaya, A. R. Baskara, and R. S. D. Kasanda, “PSO optimization on backpropagation for fish catch production prediction,” Telkomnika (Telecommunication Computing Electronics and Control), vol. 18, no. 2, pp. 776–782, 2020, doi: 10.12928/TELKOMNIKA.V18I2.14826.

Z. Liu, Z. Zhu, J. Gao, and C. Xu, “Forecast Methods for Time Series Data: A Survey,” IEEE Access, vol. 9, pp. 91896–91912, 2021, doi: 10.1109/ACCESS.2021.3091162.

W. Guo, C. Wu, Z. Ding, and Q. Zhou, “Prediction of surface roughness based on a hybrid feature selection method and long short-term memory network in grinding,” International Journal of Advanced Manufacturing Technology, vol. 112, no. 9–10, pp. 2853–2871, 2021, doi: 10.1007/s00170-020-06523-z.

K. E. ArunKumar, D. v. Kalaga, C. M. S. Kumar, M. Kawaji, and T. M. Brenza, “Forecasting of COVID-19 using deep layer Recurrent Neural Networks (RNNs) with Gated Recurrent Units (GRUs) and Long Short-Term Memory (LSTM) cells,” Chaos Solitons Fractals, vol. 146, p. 110861, 2021, doi: 10.1016/j.chaos.2021.110861.

. Kabisha, M. S., Rahim, K. A., Khaliluzzaman, M., & Khan, S. I. (2022). Face and Hand Gesture Recognition Based Person Identification System using Convolutional Neural Network. International Journal of Intelligent Systems and Applications in Engineering, 10(1), 105–115. https://doi.org/10.18201/ijisae.2022.273

W. Wu, W. Liao, J. Miao, and G. Du, “Using gated recurrent unit network to forecast short-term load considering impact of electricity price,” Energy Procedia, vol. 158, pp. 3369–3374, 2019, doi: 10.1016/j.egypro.2019.01.950.

M. S. Islam and E. Hossain, “Foreign exchange currency rate prediction using a GRU-LSTM hybrid network,” Soft Computing Letters, vol. 3, no. June 2020, p. 100009, 2021, doi: 10.1016/j.socl.2020.100009.

E. Haque, S. Tabassum, and E. Hossain, “A Comparative Analysis of Deep Neural Networks for Hourly Temperature Forecasting,” IEEE Access, vol. 9, pp. 160646–160660, 2021, doi: 10.1109/ACCESS.2021.3131533.

M. J. Traum, J. Fiorentine. (2021). Rapid Evaluation On-Line Assessment of Student Learning Gains for Just-In-Time Course Modification. Journal of Online Engineering Education, 12(1), 06–13. Retrieved from http://onlineengineeringeducation.com/index.php/joee/article/view/45

Z. Kong, B. Tang, L. Deng, W. Liu, and Y. Han, “Condition monitoring of wind turbines based on spatio-temporal fusion of SCADA data by convolutional neural networks and gated recurrent units,” Renew Energy, vol. 146, pp. 760–768, 2020, doi: 10.1016/j.renene.2019.07.033.

S. Mishra, C. Bordin, K. Taharaguchi, and I. Palu, “Comparison of deep learning models for multivariate prediction of time series wind power generation and temperature,” Energy Reports, vol. 6, no. September 2019, pp. 273–286, 2020, doi: 10.1016/j.egyr.2019.11.009.

C. Li, Y. Tao, W. Ao, S. Yang, and Y. Bai, “Improving forecasting accuracy of daily enterprise electricity consumption using a random forest based on ensemble empirical mode decomposition,” Energy, vol. 165, pp. 1220–1227, 2018, doi: 10.1016/j.energy.2018.10.113.

K. Khalil, O. Eldash, A. Kumar, and M. Bayoumi, “Machine Learning-Based Approach for Hardware Faults Prediction,” IEEE Transactions on Circuits and Systems I: Regular Papers, vol. 67, no. 11, pp. 3880–3892, 2020, doi: 10.1109/TCSI.2020.3010743.

Y. Fu, Z. Gao, Y. Liu, A. Zhang, and X. Yin, “Actuator and sensor fault classification for wind turbine systems based on fast fourier transform and uncorrelated multi-linear principal component analysis techniques,” Processes, vol. 8, no. 9, 2020, doi: 10.3390/pr8091066.

Z. Wu et al., “MoleculeNet: A benchmark for molecular machine learning,” Chem Sci, vol. 9, no. 2, pp. 513–530, 2018, doi: 10.1039/c7sc02664a.

X. Liu, Z. Lin, and Z. Feng, “Short-term offshore wind speed forecast by seasonal ARIMA - A comparison against GRU and LSTM,” Energy, vol. 227, p. 120492, 2021, doi: 10.1016/j.energy.2021.120492.

H. D. Nguyen, K. P. Tran, S. Thomassey, and M. Hamad, “Forecasting and Anomaly Detection approaches using LSTM and LSTM Autoencoder techniques with the applications in supply chain management,” Int J Inf Manage, vol. 57, no. November, p. 102282, 2021, doi: 10.1016/j.ijinfomgt.2020.102282.

D. Tukymbekov, A. Saymbetov, M. Nurgaliyev, N. Kuttybay, G. Dosymbetova, and Y. Svanbayev, “Intelligent autonomous street lighting system based on weather forecast using LSTM,” Energy, vol. 231, p. 120902, 2021, doi: 10.1016/j.energy.2021.120902.

J. Luo, Z. Zhang, Y. Fu, and F. Rao, “Time series prediction of COVID-19 transmission in America using LSTM and XGBoost algorithms,” Results Phys, vol. 27, p. 104462, 2021, doi: 10.1016/j.rinp.2021.104462.

A. Mellit, A. M. Pavan, and V. Lughi, “Deep learning neural networks for short-term photovoltaic power forecasting,” Renew Energy, vol. 172, pp. 276–288, 2021, doi: 10.1016/j.renene.2021.02.166.

N. AlDahoul et al., “Suspended sediment load prediction using long short-term memory neural network,” Sci Rep, vol. 11, no. 1, pp. 1–22, 2021, doi: 10.1038/s41598-021-87415-4.

D. Chicco, M. J. Warrens, and G. Jurman, “The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression analysis evaluation,” PeerJ Comput Sci, vol. 7, pp. 1–24, 2021, doi: 10.7717/PEERJ-CS.623.

X. Zhang, Q. Zhang, G. Zhang, Z. Nie, Z. Gui, and H. Que, “A novel hybrid data-driven model for daily land surface temperature forecasting using long short-term memory neural network based on ensemble empirical mode decomposition,” Int J Environ Res Public Health, vol. 15, no. 5, 2018, doi: 10.3390/ijerph15051032.

Hybrid GRU-LSTM Model Architecture

Downloads

Published

01.10.2022

How to Cite

Sari, Y. ., Arifin, Y. F. ., Novitasari, N. ., & Faisal, M. R. . (2022). Deep Learning Approach Using the GRU-LSTM Hybrid Model for Air Temperature Prediction on Daily Basis . International Journal of Intelligent Systems and Applications in Engineering, 10(3), 430–436. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2184

Issue

Section

Research Article