Deep learning for post-processing global probabilistic forecasts on sub-seasonal time scales
Abstract: Sub-seasonal weather forecasts are becoming increasingly important for a range of socio-economic activities. However, the predictive ability of physical weather models is very limited on these time scales. We propose several post-processing methods based on convolutional neural networks to improve sub-seasonal forecasts by correcting systematic errors of numerical weather prediction models. Our post-processing models operate directly on spatial input fields and are therefore able to retain spatial relationships and to generate spatially homogeneous predictions. They produce global probabilistic tercile forecasts for biweekly aggregates of temperature and precipitation for weeks 3-4 and 5-6. In a case study based on a public forecasting challenge organized by the World Meteorological Organization, our post-processing models outperform recalibrated forecasts from the European Centre for Medium-Range Weather Forecasts (ECMWF), and achieve improvements over climatological forecasts for all considered variables and lead times. We compare several model architectures and training modes and demonstrate that all approaches lead to skillful and well-calibrated probabilistic forecasts. The good calibration of the post-processed forecasts emphasizes that our post-processing models reliably quantify the forecast uncertainty based on deterministic input information in form of the ECMWF ensemble mean forecast fields only.
- Tensorflow: A system for large-scale machine learning. In Proc. USENIX 12th Symposium on Operating Systems Design and Implementation. 265–283.
- RainNet v1.0: A convolutional neural network for radar-based precipitation nowcasting. Geoscientific Model Development, 13, 2631–2644.
- Probabilistic seasonal forecasts in the North American multimodel ensemble: A baseline skill assessment. Journal of Climate, 29, 3015–3026.
- Improving medium-range ensemble weather forecasts with hierarchical ensemble transformers. URL https://arxiv.org/abs/2303.17195.
- Collaboration of the weather and climate communities to advance subseasonal-to-seasonal prediction. Bulletin of the American Meteorological Society, 91, 1397–1406.
- Probabilistic predictions from deterministic atmospheric river forecasts with deep learning. Monthly Weather Review, 150, 215–234.
- Chollet, F. et al. (2015). Keras. https://keras.io. URL https://github.com/fchollet/keras.
- Deep neural networks segment neuronal membranes in electron microscopy images. In Advances in Neural Information Processing Systems, vol. 4. 2843–2851.
- Spatially coherent postprocessing of cloud cover ensemble forecasts. Monthly Weather Review, 149, 3923–3937.
- The EUPPBench postprocessing benchmark dataset v1.0. Earth System Science Data, 15, in press.
- The rationale behind the success of multi-model ensembles in seasonal forecasting – II. Calibration and combination. Tellus A: Dynamic Meteorology and Oceanography, 57, 234–252.
- Why do forecasts for “Near Normal” often fail? Weather and Forecasting, 6, 76 – 85.
- Epstein, E. S. (1969). A scoring system for probability forecasts of ranked categories. Journal of Applied Meteorology, 8, 985–987.
- Probabilistic forecasts, calibration and sharpness. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 69, 243–268.
- Deep learning for post-processing ensemble weather forecasts. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 379, 20200092.
- Towards implementing artificial intelligence post-processing in weather and climate: Proposed actions from the Oxford 2019 workshop. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 379, 20200091.
- Combining artificial intelligence with physics-based methods for probabilistic renewable energy forecasting. Energies, 13, 1979.
- Deep learning forecast uncertainty for precipitation over Western US. Monthly Weather Review, 151, 1367–1385.
- Adam: A method for stochastic optimization. URL https://arxiv.org/abs/1412.6980.
- Using deep learning to nowcast the spatial coverage of convection from Himawari-8 satellite data. Monthly Weather Review, 149, 3897 – 3921.
- Introduction to special collection: “Bridging weather and climate: Subseasonal-to-seasonal (S2S) prediction”. Journal of Geophysical Research: Atmospheres, 125, e2019JD031833.
- Convolutional autoencoders for spatially-informed ensemble post-processing. International Conference on Learning Representations (ICLR) 2022 - AI for Earth and Space Science Workshop, URL https://arxiv.org/abs/2204.05102.
- Convolutional neural network-based statistical post-processing of ensemble precipitation forecasts. Journal of Hydrology, 605, 127301.
- Multimodel subseasonal precipitation forecasts over the contiguous United States: Skill assessment and statistical postprocessing. Journal of Hydrometeorology, 22, 2581–2600.
- A survey on deep learning in medical image analysis. Medical Image Analysis, 42, 60–88.
- Efficient patch-wise semantic segmentation for large-scale remote sensing images. Sensors, 18, 3232.
- Windows of opportunity for skillful forecasts subseasonal to seasonal and beyond. Bulletin of the American Meteorological Society, 101, E608–E625.
- Subseasonal forecasts of opportunity identified by an explainable neural network. Geophysical Research Letters, 48, e2020GL092092.
- Current and emerging developments in subseasonal to decadal prediction. Bulletin of the American Meteorological Society, 101, E869–E896.
- Nonhomogeneous boosting for predictor selection in ensemble postprocessing. Monthly Weather Review, 145, 137–147.
- Learned benchmarks for subseasonal forecasting. URL https://arxiv.org/abs/2109.10399.
- Murphy, A. H. (1971). A note on the ranked probability score. Journal of Applied Meteorology, 10, 155–156.
- Reliability of subjective probability forecasts of precipitation and temperature. Applied Statistics, 26, 41.
- Evaluating ensemble post-processing for wind power forecasts. Wind Energy, 25, 1379–1405.
- EuLerian Identification of ascending AirStreams (ELIAS 2.0) in numerical weather prediction and climate models – part 1: Development of deep learning model. Geoscientific Model Development, 15, 715–730.
- Neural networks for postprocessing ensemble weather forecasts. Monthly Weather Review, 146, 3885–3900.
- Resin, J. (2021). CalSim: The Calibration Simplex. R package version 0.5.2.
- Subseasonal to seasonal prediction of weather to climate with application to tropical cyclones. Journal of Geophysical Research: Atmospheres, 125, e2018JD029375.
- U-Net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015 (N. Navab, J. Hornegger, W. M. Wells and A. F. Frangi, eds.). Springer International Publishing, Cham, 234–241.
- Evaluation of machine learning techniques for forecast uncertainty quantification. Quarterly Journal of the Royal Meteorological Society, 148, 3470–3490.
- Using artificial neural networks for generating probabilistic subseasonal precipitation forecasts over California. Monthly Weather Review, 148, 3489–3506.
- Machine learning methods for postprocessing ensemble forecasts of wind gusts: A systematic comparison. Monthly Weather Review, 150, 235–257.
- Calibrated ensemble forecasts using quantile regression forests and ensemble model output statistics. Monthly Weather Review, 144, 2375–2393.
- Statistical postprocessing for weather forecasts: Review, challenges, and avenues in a big data world. Bulletin of the American Meteorological Society, 102, E681–E699.
- Statistical postprocessing of wind speed forecasts using convolutional neural networks. Monthly Weather Review, 149, 1141–1152.
- Multimodel ensembling of subseasonal precipitation forecasts over North America. Monthly Weather Review, 145, 3913–3928.
- Probabilistic skill of subseasonal surface temperature forecasts over North America. Weather and Forecasting, 34, 1789–1806.
- The subseasonal to seasonal (S2S) prediction project database. Bulletin of the American Meteorological Society, 98, 163–173.
- Outcomes of the WMO prize challenge to improve subseasonal to seasonal predictions using artificial intelligence. Bulletin of the American Meteorological Society, 103, E2878–E2886.
- Improving data‐driven global weather prediction using deep convolutional neural networks on a cubed sphere. Journal of Advances in Modeling Earth Systems, 12, e2020MS002109.
- Potential applications of subseasonal-to-seasonal (S2S) predictions. Meteorological Applications, 24, 315–325.
- Advances in the application and utility of subseasonal-to-seasonal predictions. Bulletin of the American Meteorological Society, 103, E1448–E1472.
- Wilks, D. S. (2013). The Calibration Simplex: A generalization of the reliability diagram for three-category probability forecasts. Weather and Forecasting, 28, 1210–1218.
- Wilks, D. S. (2020). Statistical methods in the atmospheric sciences. 4th ed. Elsevier.
- Improving subseasonal-to-seasonal forecasts in predicting the occurrence of extreme precipitation events over the contiguous U.S. using machine learning models. Atmospheric Research, 281, 106502.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.