Clustering-based Multitasking Deep Neural Network for Solar Photovoltaics Power Generation Prediction
Abstract: The increasing installation of Photovoltaics (PV) cells leads to more generation of renewable energy sources (RES), but results in increased uncertainties of energy scheduling. Predicting PV power generation is important for energy management and dispatch optimization in smart grid. However, the PV power generation data is often collected across different types of customers (e.g., residential, agricultural, industrial, and commercial) while the customer information is always de-identified. This often results in a forecasting model trained with all PV power generation data, allowing the predictor to learn various patterns through intra-model self-learning, instead of constructing a separate predictor for each customer type. In this paper, we propose a clustering-based multitasking deep neural network (CM-DNN) framework for PV power generation prediction. K-means is applied to cluster the data into different customer types. For each type, a deep neural network (DNN) is employed and trained until the accuracy cannot be improved. Subsequently, for a specified customer type (i.e., the target task), inter-model knowledge transfer is conducted to enhance its training accuracy. During this process, source task selection is designed to choose the optimal subset of tasks (excluding the target customer), and each selected source task uses a coefficient to determine the amount of DNN model knowledge (weights and biases) transferred to the aimed prediction task. The proposed CM-DNN is tested on a real-world PV power generation dataset and its superiority is demonstrated by comparing the prediction performance on training the dataset with a single model without clustering.
- D. Markovics and M. J. Mayer, “Comparison of machine learning methods for photovoltaic power forecasting based on numerical weather prediction,” Renewable and Sustainable Energy Reviews, vol. 161, pp. 1–17, 2022.
- H. Song, M. Gu, C. Liu, A. M. Amani, M. Jalili, L. Meegahapola, X. Yu, and G. Dickeson, “Multi-objective battery energy storage optimization for virtual power plant applications,” Applied Energy, vol. 352, pp. 1–12, 2023.
- Q. Li, X. Zhang, T. Ma, C. Jiao, H. Wang, and W. Hu, “A multi-step ahead photovoltaic power prediction model based on similar day, enhanced colliding bodies optimization, variational mode decomposition, and deep extreme learning machine,” Energy, vol. 224, pp. 1–20, 2021.
- J. Du, J. Zheng, Y. Liang, Q. Liao, B. Wang, X. Sun, H. Zhang, M. Azaza, and J. Yan, “A theory-guided deep-learning method for predicting power generation of multi-region photovoltaic plants,” Engineering Applications of Artificial Intelligence, vol. 118, pp. 1–17, 2023.
- H. Alghamdi, C. Maduabuchi, A. Albaker, I. Alatawi, T. R. Alsenani, A. S. Alsafran, A. Almalaq, M. AlAqil, M. A. Abdelmohimen, and M. Alkhedher, “A prediction model for the performance of solar photovoltaic-thermoelectric systems utilizing various semiconductors via optimal surrogate machine learning methods,” Engineering Science and Technology, an International Journal, vol. 40, pp. 1–17, 2023.
- Y. Zhou, N. Zhou, L. Gong, and M. Jiang, “Prediction of photovoltaic power output based on similar day analysis, genetic algorithm and extreme learning machine,” Energy, vol. 204, pp. 1–10, 2020.
- S. Zhang, J. Wang, H. Liu, J. Tong, and Z. Sun, “Prediction of energy photovoltaic power generation based on artificial intelligence algorithm,” Neural Computing and Applications, vol. 33, pp. 821–835, 2021.
- B. Zazoum, “Solar photovoltaic power prediction using different machine learning methods,” Energy Reports, vol. 8, pp. 19–25, 2022.
- T. Polasek and M. Čadík, “Predicting photovoltaic power production using high-uncertainty weather forecasts,” Applied Energy, vol. 339, pp. 1–15, 2023.
- K. Qiao, K. Yu, B. Qu, J. Liang, H. Song, and C. Yue, “An evolutionary multitasking optimization framework for constrained multiobjective optimization problems,” IEEE Transactions on Evolutionary Computation, vol. 26, no. 2, pp. 263–277, 2022.
- K. Qiao, K. Yu, B. Qu, J. Liang, H. Song, C. Yue, H. Lin, and K. C. Tan, “Dynamic auxiliary task-based evolutionary multitasking for constrained multi-objective optimization,” IEEE Transactions on Evolutionary Computation, 2022.
- H. Wang, L. Mao, H. Zhang, and Q. Wu, “Multi-prediction of electric load and photovoltaic solar power in grid-connected photovoltaic system using state transition method,” Applied Energy, vol. 353, p. 122138, 2024.
- Y. Ju, J. Li, and G. Sun, “Ultra-short-term photovoltaic power prediction based on self-attention mechanism and multi-task learning,” IEEE Access, vol. 8, pp. 44 821–44 829, 2020.
- T. Shireen, C. Shao, H. Wang, J. Li, X. Zhang, and M. Li, “Iterative multi-task learning for time-series modeling of solar panel pv outputs,” Applied Energy, vol. 212, pp. 654–662, 2018.
- B. Wang, W. Cui, C. Wang, and H. Xu, “Regional distributed photovoltaic ultra-short-term prediction method based on multi-task learning,” in Proc. of IEEE 4th International Electrical and Energy Conference (CIEEC). IEEE, 2021, pp. 1–5.
- H. Song, A. K. Qin, and C. Yan, “Multi-task optimization based co-training for electricity consumption prediction,” in Proc. of 2022 International Joint Conference on Neural Networks (IJCNN). IEEE, 2022, pp. 1–8.
- H. Song, N. Al Khafaf, A. Kamoona, S. S. Sajjadi, A. M. Amani, M. Jalili, X. Yu, and P. McTaggart, “Multitasking recurrent neural network for photovoltaic power generation prediction,” Energy Reports, vol. 9, pp. 369–376, 2023.
- T. Kanungo, D. M. Mount, N. S. Netanyahu, C. D. Piatko, R. Silverman, and A. Y. Wu, “An efficient k-means clustering algorithm: Analysis and implementation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 881–892, 2002.
- S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural Computation, vol. 9, no. 8, pp. 1735–1780, 1997.
- D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014.
- H. Song, M. Jalili, X. Yu, and P. McTaggart, “Two-stage multitasking energy demand prediction,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2023.
- J. Kennedy and R. Eberhart, “Particle swarm optimization,” in Proc. of ICNN’95-International Conference on Neural Networks, vol. 4. IEEE, 1995, pp. 1942–1948.
- H. Song, A. K. Qin, P. W. Tsai, and J. J. Liang, “Multitasking multi-swarm optimization,” in Proc. of 2019 IEEE Congress on Evolutionary Computation (CEC). IEEE, 2019, pp. 1937–1944.
- I. E. Livieris, E. Pintelas, and P. Pintelas, “A cnn–lstm model for gold price time-series forecasting,” Neural Computing and Applications, vol. 32, no. 23, pp. 17 351–17 360, 2020.
- K. Cho, B. Van Merriënboer, D. Bahdanau, and Y. Bengio, “On the properties of neural machine translation: Encoder-decoder approaches,” arXiv preprint arXiv:1409.1259, 2014.
- A. K. Qin and P. N. Suganthan, “Initialization insensitive LVQ algorithm based on cost-function adaptation,” Pattern Recognition, vol. 38, no. 5, pp. 773–776, 2005.
- A. K. Qin and X. Li, “Differential evolution on the CEC-2013 single-objective continuous optimization testbed,” in 2013 IEEE Congress on Evolutionary Computation, 2013, pp. 1099–1106.
- G. Gao, Z. Bao, J. Cao, A. K. Qin, and T. Sellis, “Location-centered house price prediction: A multi-task learning approach,” ACM Transactions on Intelligent Systems and Technology (TIST), vol. 13, no. 2, pp. 1–25, 2022.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.