An Adaptive Salp-Stochastic-Gradient-Descent-Based Convolutional LSTM With MapReduce Framework for the Prediction of Rainfall.
DOI:
https://doi.org/10.9781/ijimai.2024.01.003Keywords:
ConLSTM, MapReduce, Mean Square Error (MSE), Mean Square Difference (PRD), S-SGDAbstract
Rainfall prediction is considered to be an esteemed research area that impacts the day-to-day life of Indians. The predominant income source of most of the Indian population is agriculture. It helps the farmers to make the appropriate decisions pertaining to cultivation and irrigation. The primary objective of this investigation is to develop a technique for rainfall prediction utilising the MapReduce framework and the convolutional long short-term memory (ConvLSTM) method to circumvent the limitations of higher computational requirements and the inability to process a large number of data points. In this work, an adaptive salp-stochastic-gradientdescent-based ConvLSTM (adaptive S-SGD-based ConvLSTM) system has been developed to predict rainfall accurately to process the long time series data and to eliminate the vanishing problems. To optimize the hyperparameter of the convLSTM model, the S-SGD methodology proposed combine the SGD and the salp swarm algorithm (SSA). The adaptive S-SGD based ConvLSTM has been developed by integrating the adaptive concept in S-SGD. It tunes the weights of ConvLSTM optimally to achieve better prediction accuracy. Assessment measures, such as the percentage root mean square difference (PRD) and mean square error (MSE), were employed to compare the suggested method with previous approaches. The developed system demonstrates high prediction accuracy, achieving minimal values for MSE (0.0042) and PRD (0.8450).
Downloads
References
J. Majumdar, S. Naraseeyappa and S. Ankalaki, “Analysis of agriculture data using data mining techniques: application of big data,” Journal of Big data, vol. 4, no. 1, pp. 1-5, 2017.
S. Rajeswari, K. Suthendran and K. Rajakumar, “A smart agricultural model by integrating IoT, mobile and cloud-based big data analytics,” In IEEE international conference on intelligent computing and control, pp. 1-5, 2017.
I. Pani, D. D. Putranto and P. K. Wardhani, “Net present value (NPV) of the rehabilitated irrigation channels to increase agricultural production,” International Journal of Advanced Technology and Engineering Exploration, vol. 8, no. 78, pp. 576-583, 2021.
A. Y. Barrera-Animas, L. O. Oyedele, M. Bilal, T. D. Akinosho, J. M. Delgado and L. A. Akanbi, “Rainfall prediction: A comparative analysis of modern machine learning algorithms for time-series forecasting,” Machine Learning with Applications, vol. 7, 2022.
B. Abishek, R. Priyatharshini, M. A. Eswar and P. Deepika, “Prediction of effective rainfall and crop water needs using data mining techniques,” In IEEE technological innovations in ICT for agriculture and rural development, pp. 231-235, 2017.
S. Jha, A. Dey, R. Kumar, V. Kumar, “A novel approach on visual question answering by parameter prediction using faster region based convolutional neural network,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 5, no. 5, pp. 30-37, 2019.
P. C. Chiu, A. Selamat, O. Krejcar, K. K. Kuok, E. Herrera-Viedma, G. Fenza, “Imputation of Rainfall Data Using the Sine Cosine Function Fitting Neural Network,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 6, no. 7, pp. 39-48, 2021.
A. M. Bagirov, A. Mahmood and A. Barton, “Prediction of monthly rainfall in Victoria, Australia: Clusterwise linear regression approach,” Atmospheric Research, vol. 188, pp. 20-29, 2017.
A. K. Dubey, A. Kumar, V. García-Díaz, A. K. Sharma and K. Kanhaiya, “Study and analysis of SARIMA and LSTM in forecasting time series data,” Sustainable Energy Technologies and Assessments, vol. 47, 2021.
M. A. Rahman, L. Yunsheng and N. Sultana, “Analysis and prediction of rainfall trends over Bangladesh using Mann–Kendall, Spearman’s rho tests and ARIMA model,” Meteorology and Atmospheric Physics, vol. 129, no. 4, pp. 409-424, 2017.
A. Sharifian, Á. Fernández-Llamazares, H. Wario, Z. Molnár and M. Cabeza, “Dynamics of pastoral traditional ecological knowledge: a global state-of-the-art review,” Ecology and Society, vol. 27, no. 1, pp. 1-63, 2022.
Z. Beheshti, M. Firouzi, S. M. Shamsuddin, M. Zibarzani and Z. Yusop, “A new rainfall forecasting model using the CAPSO algorithm and an artificial neural network,” Neural Computing and Applications, vol. 27, no. 8, pp. 2551-2565, 2016.
I. Wahyuni, W. F. Mahmudy and A. Iriany, “Rainfall prediction using hybrid adaptive neuro fuzzy inference system (ANFIS) and genetic algorithm,” Journal of Telecommunication, Electronic and Computer Engineering, vol. 9, no. 2, pp. 51-56, 2017.
A. J. Hussain, P. Liatsis, M. Khalaf, H. Tawfik and H. Al-Asker, “A dynamic neural network architecture with immunology inspired optimization for weather data forecasting,” Big Data Research, vol. 14, pp. 81-92, 2018.
S. Bhomia, N. Jaiswal, C. M. Kishtawal and R. Kumar, “Multimodel prediction of monsoon rain using dynamical model selection,” IEEE Transactions on Geoscience and Remote Sensing, vol. 54, no. 5, pp. 2911-2917, 2016.
A. Haidar and B. Verma, “Monthly rainfall forecasting using one-dimensional deep convolutional neural network,” IEEE Access, vol. 6, pp. 69053-69063, 2018.
K. Zhou, Y. Zheng, B. Li, W. Dong and X. Zhang, “Forecasting different types of convective weather: A deep learning approach,” Journal of Meteorological Research, vol. 33, no. 5, pp. 797-809, 2019.
S. Poornima and M. Pushpalatha, “Prediction of rainfall using intensified LSTM based recurrent neural network with weighted linear units,” Atmosphere, vol. 10, no. 11, 2019.
D. Tran Anh, S. P. Van, T.D. Dang and L.P. Hoang, “Downscaling rainfall using deep learning long short‐term memory and feedforward neural network,” International Journal of Climatology, vol. 39, no. 10, pp. 4170-4188, 2019.
L. Diop, S. Samadianfard, A. Bodian, Z. M. Yaseen, M. A. Ghorbani and H. Salimi, “Annual rainfall forecasting using hybrid artificial intelligence model: integration of multilayer perceptron with whale optimization algorithm,” Water Resources Management, vol. 34, no. 2, pp. 733-746, 2020.
M. I. Khan and R. Maity, “Hybrid deep learning approach for multi-step-ahead daily rainfall prediction using GCM simulations,” IEEE Access, vol. 8, pp. 52774-52784, 2020.
X. Zhang, S. N. Mohanty, A. K. Parida, S. K. Pani, B. Dong and X. Cheng,“Annual and non-monsoon rainfall prediction modelling using SVR-MLP: an empirical study from Odisha,” IEEE Access, vol. 8, pp. 30223-30233, 2020.
A. B. Putra, R. Malani, B. Suprapty and A. F. Gaffar, “A Deep Auto Encoder Semi Convolution Neural Network for Yearly Rainfall Prediction,” In IEEE International Seminar on Intelligent Technology and Its Applications, pp. 205-210, 2020.
P. Hewage, A. Behera, M. Trovati, E. Pereira, M. Ghahremani, F. Palmieri and Y. Liu, “Temporal convolutional neural (TCN) network for an effective weather forecasting using time-series data from the local weather station,” Soft Computing, vol. 24, no. 21, pp. 16453-16482, 2020.
D. Zhang, G. Lindholm and H. Ratnaweera, “Use long short-term memory to enhance Internet of Things for combined sewer overflow monitoring,” Journal of Hydrology, vol. 556, pp. 409-418, 2018.
W. M. Ridwan, M. Sapitang, A. Aziz, K. F. Kushiar, A. N. Ahmed and A. El-Shafie, “Rainfall forecasting model using machine learning methods: Case study Terengganu, Malaysia,” Ain Shams Engineering Journal, vol. 12, no. 2, pp. 1651-1663, 2021.
K. U. Jaseena and B. C. Kovoor, “Deterministic weather forecasting models based on intelligent predictors: A survey,” Journal of King Saud University-Computer and Information Sciences, vol. 34, no. 6, pp. 3393-3412, 2020.
A. M. Ahmed, R. C. Deo, Q. Feng A. Ghahramani, N. Raj, Z. Yin and L. Yang, “Deep learning hybrid model with Boruta-Random Forest optimiser algorithm for streamflow forecasting with climate mode indices, rainfall, and periodicity,” Journal of Hydrology, vol. 599, 126350, 2021.
D. Sun, J. Wu, H. Huang, R. Wang, F. Liang and H. Xinhua, “Prediction of short-time rainfall based on deep learning,” Mathematical Problems in Engineering, 2021.
D. Tran Anh, T. Duc Dang and S. Pham Van, “Improved rainfall prediction using combined pre-processing methods and feed-forward neural networks,” J, vol. 2, no. 1, pp. 65-83, 2019.
Y. Lin, D. Wang, G. Wang, J. Qiu, K. Long, Y. Du, H. Xie, Z. Wei, W. Shangguan and Y. Dai, “A hybrid deep learning algorithm and its application to streamflow prediction,” Journal of Hydrology, vol. 601, 126636, 2021.
L. C. Velasco, R. P. Serquiña, M. S. Zamad, B. F. Juanico and J. C. Lomocso, “Week-ahead rainfall forecasting using multilayer perceptron neural network,” Procedia Computer Science, vol. 161, pp. 386-397, 2019.
S. Dewitte, J. P. Cornelis, R. Müller and A. Munteanu, “Artificial intelligence revolutionises weather forecast, climate monitoring and decadal prediction,” Remote Sensing, vol. 13, no. 16, 2021.
E. A. Hussein, M. Ghaziasgar, C. Thron, M. Vaccari and Bagula, “Basic statistical estimation outperforms machine learning in monthly prediction of seasonal climatic parameters,” Atmosphere, vol. 12, no. 5, 2021.
J. Yan, T. Xu, Y. Yu and H. Xu, “Rainfall forecast model based on the tabnet model,” Water, vol. 13, no. 9, 2021.
J. Yang and G. Yang, “Modified convolutional neural network based on dropout and the stochastic gradient descent optimizer,” Algorithms, vol. 11, no. 3, 2018.
R. Janarthanan, R. Balamurali, A. Annapoorani and V. Vimala, “Prediction of rainfall using fuzzy logic,” Materials Today: Proceedings, vol. 37, pp. 959-963, 2021.
D. Z. Haq, D. C. Novitasari, A. Hamid, N. Ulinnuha, Y. Farida, R. D. Nugraheni, R. Nariswari, H. Rohayani, R. Pramulya and A. Widjayanto, “Long short-term memory algorithm for rainfall prediction based on El-Nino and IOD data,” Procedia Computer Science, pp. 829-837, 2021.
B. T. Pham, L. M. Le, T. T Le, K.T Bui, V. M. Le, H. B. Ly and I. Prakash, “Development of advanced artificial intelligence models for daily rainfall prediction,” Atmospheric Research, vol. 237, 104845, 2020.
Y. Zhao, X. Meng, T. Qi, Y. Li, G. Chen, D. Yue and F. Qing, “AI-based rainfall prediction model for debris flows,” Engineering Geology, vol. 296, 106456, 2022.
M. Shrestha, S. P. Panday, B. Joshi, A. Shakya and R. K. Pandey, “Automatic pose estimation of micro unmanned aerial vehicle for autonomous landing,” In international conference on intelligent computing, pp. 3-15, 2020.
M. Chhetri, S. Kumar, P. R. Pratim and B. G. Kim, “Deep BLSTM-GRU model for monthly rainfall prediction: A case study of Simtokha, Bhutan,” Remote sensing, vol. 12, no. 19, 2020.
J. Diez-Sierra, M. J. Del, “Long-term rainfall prediction using atmospheric synoptic patterns in semi-arid climates with statistical and machine learning methods,” Journal of Hydrology, vol. 586, 124789, 2020.
C. J. Zhang, H. Y. Wang, J. Zeng, L. M. Ma and L. Guan, “Tiny‐RainNet: a deep convolutional neural network with bi‐directional long short‐term memory model for short‐term rainfall prediction,” Meteorological Applications, vol. 27, no. 5, 2020.
W. Li, A. Kiaghadi and C. Dawson, “High temporal resolution rainfall–runoff modeling using long-short-term-memory (LSTM) networks,” Neural Computing and Applications, vol. 33, no. 4, pp. 1261–1278, 2021.
P. Hewage, M. Trovati, E. Pereira and A. Behera, “Deep learning-based effective fine-grained weather forecasting model,” Pattern Analysis and Applications, vol. 24, no. 1, pp. 343-366, 2021.
R. Venkatesh, C. Balasubramanian and M. Kaliappan, “Rainfall prediction using generative adversarial networks with convolution neural network,” Soft Computing, vol. 25, no. 6, pp. 4725-4738, 2021.
X. Ren, X. Li, K. Ren, J. Song, Z. Xu, K. Deng and X. Wang, “Deep learning-based weather prediction: a survey,” Big Data Research, 2021.
B. Kumar, R. Chattopadhyay, M. Singh, N. Chaudhari, K. Kodari and A. Barve, “Deep learning–based downscaling of summer monsoon rainfall data over Indian region,” Theoretical and Applied Climatology, vol. 143, no. 3, pp. 1145-1156, 2021.
S. A. Fayaz, M. Zaman, and M. A. Butt, “A hybrid adaptive grey wolf Levenberg-Marquardt (GWLM) and nonlinear autoregressive with exogenous input (NARX) neural network model for the prediction of rainfall,” International Journal of Advanced Technology and Engineering Exploration, vol. 9, no. 89, pp. 509-522, 2022.
A. U. Rahman, S. Abbas, M. Gollapalli, R. Ahmed, S. Aftab, M. Ahmad, M. A. Khan and A. Mosavi, “Rainfall Prediction System Using Machine Learning Fusion for Smart Cities,” Sensors, vol. 22, no. 9, 2022.
J. P. Ananth and S. O. Manoj, “MapReduce and optimized deep network for rainfall prediction in agriculture,” The Computer Journal, vol. 63, no. 6, pp. 900-912, 2020.
Downloads
Published
-
Abstract443
-
PDF97
Submit Article
Information
