- Invited
- Access by Xinjiang University
Probabilistic forecasts of extreme heatwaves using convolutional neural networks in a regime of lack of data
Phys. Rev. Fluids 8, 040501 – Published 4 April, 2023
DOI: https://doi.org/10.1103/PhysRevFluids.8.040501
Abstract
Understanding extreme events and their probability is key for the study of climate change impacts, risk assessment, adaptation, and the protection of living beings. Extreme heatwaves are, and likely will be in the future, among the deadliest weather events. Forecasting their occurrence probability a few days, weeks, or months in advance is a primary challenge for risk assessment and attribution but also for fundamental studies about processes, dataset and model validation, and climate change studies. In this work we develop a methodology to build forecasting models which are based on convolutional neural networks, trained on extremely long 8000-year climate model outputs. This approach is parallel to weather model forecasting and has complementary scopes. Because the relation between extreme events is intrinsically probabilistic, we emphasize probabilistic forecast and validation. We demonstrate that neural networks have positive predictive skills, with respect to random climatological forecasts, for the occurrence of long-lasting 14-day heatwaves over France, up to 15 days ahead of time for fast dynamical drivers (500 hPa geopotential height fields), and also at much longer lead times for slow physical drivers (soil moisture). This forecast is made seamlessly in time and space, for fast hemispheric and slow local drivers. The method is easily implemented and versatile. We find that the neural network selects extreme heatwaves associated with a north hemisphere wave-number 3 pattern. We argue that this machine learning approach should be key in the future for quantitative process studies, model intercomparisons, and dataset studies. For instance, we find that the 2 meter temperature field does not contain any new useful statistical information for heatwave forecast, when added to the 500 hPa geopotential height and soil moisture fields. The main scientific message is that most of the times, training neural networks for predicting extreme heatwaves occurs in a regime of lack of data. We suggest that this is likely to be the case for most other applications to large-scale atmosphere and climate phenomena. Depending on the information to be learned, training might require dataset lengths as long as several thousands of years, or even more, for optimal forecasting skill. For instance, using 100-year-long training sets, a regime of drastic lack of data, leads to severely lower predictive skills and general inability to extract useful information available in the 500 hPa geopotential height field at a hemispheric scale in contrast to the dataset of several thousand years long. Even with several-thousand-year-long datasets, no convergence is observed in the predictive skills coming from hemispheric geopotential height fields. We discuss perspectives for dealing with the lack of data regime, for instance, rare event simulations and how transfer learning may play a role in this latter task.
Physics Subject Headings (PhySH)
Article Text
References (100)
- IPCC, Climate Change 2021: The Physical Science Basis. Contribution of Working Group I to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change (Cambridge University Press, Cambridge, UK/New York, NY, 2021).
- S. Seneviratne, X. Zhang, M. Adnan, W. Badi, C. Dereczynski, A. Di Luca, S. Ghosh, I. Iskandar, J. Kossin, S. Lewis, F. Otto, I. Pinto, M. Satoh, S. Vicente-Serrano, M. Wehner, and B. Zhou, Weather and Climate Extreme Events in a Changing Climate (Cambridge University Press, Cambridge, UK/New York, NY, 2021), pp. 1513–1766.
- United Nations Office for Disaster Risk Reduction (UNISDR), Review of disaster events (Centre for Research on the Epidemiology of Disasters (CRED), Brussels, Belgium, 2018).
- R. García-Herrera, J. Díaz, R. M. Trigo, J. Luterbacher, and E. M. Fischer, A review of the European summer heat wave of 2003, Crit. Rev. Environ. Sci. Technol. 40, 267 (2010).
- H. M. Fritz, C. D. Blount, S. Thwin, M. K. Thu, and N. Chan, Cyclone Nargis storm surge in Myanmar, Nat. Geosci. 2, 448 (2009).
- D. Barriopedro, E. M. Fischer, J. Luterbacher, R. M. Trigo, and R. García-Herrera, The hot summer of 2010: Redrawing the temperature record map of Europe, Science 332, 220 (2011).
- F. Otto, N. Massey, G. J. Van Oldenborgh, R. Jones, and M. Allen, Reconciling two approaches to attribution of the 2010 Russian heat wave, Geophys. Res. Lett. 39, L04702 (2012).
- S. Y. Philip, S. F. Kew, G. J. van Oldenborgh, F. S. Anslow, S. I. Seneviratne, R. Vautard, D. Coumou, K. L. Ebi, J. Arrighi, R. Singh et al., Rapid attribution analysis of the extraordinary heatwave on the Pacific Coast of the U.S. and Canada June 2021, in Earth System Dynamics Discussions (Copernicus Publications, Gottingen, Germany, 2021), pp. 1–34.
- T. Woollings, D. Barriopedro, J. Methven, S.-W. Son, O. Martius, B. Harvey, J. Sillmann, A. R. Lupo, and S. Seneviratne, Blocking and its response to climate change, Curr. Clim. Change 4, 287 (2018).
- K. Fraedrich, H. Jansen, E. Kirk, U. Luksch, and F. Lunkeit, The planet simulator: Toward a user friendly model, Meteorologische Zeitschrift 14, 299 (2005).
- N. Nakamura and C. S. Huang, Atmospheric blocking as a traffic jam in the jet stream, Science 361, 42 (2018).
- L. Wang and Z. Kuang, Evidence against a general positive eddy feedback in atmospheric blocking, arXiv:1907.00999.
- R. M. Horton, J. S. Mankin, C. Lesk, E. Coffel, and C. Raymond, A review of recent advances in research on extreme heat events, Curr. Climate Change Rep. 2, 242 (2016).
- S. E. Perkins, A review on the scientific understanding of heatwaves—Their measurement, driving mechanisms, and changes at the global scale, Atmos. Res. 164-165, 242 (2015).
- D. O. Benson and P. A. Dirmeyer, Characterizing the relationship between temperature and soil moisture extremes and their role in the exacerbation of heat waves over the contiguous united states, J. Climate 34, 2175 (2021).
- F. D'Andrea, A. Provenzale, R. Vautard, and N. De Noblet-Decoudré, Hot and cool summers: Multiple equilibria of the continental water cycle, Geophys. Res. Lett. 33, L24807 (2006).
- E. M. Fischer, S. I. Seneviratne, P. L. Vidale, D. Lüthi, and C. Schär, Soil moisture–atmosphere interactions during the 2003 European summer heat wave, J. Climate 20, 5081 (2007).
- M. Hirschi, S. I. Seneviratne, V. Alexandrov, F. Boberg, C. Boroneant, O. B. Christensen, H. Formayer, B. Orlowsky, and P. Stepanek, Observational evidence for soil-moisture impact on hot extremes in southeastern Europe, Nat. Geosci. 4, 17 (2011).
- R. Lorenz, E. B. Jaeger, and S. I. Seneviratne, Persistence of heat waves and its link to soil moisture memory, Geophys. Res. Lett. 37, L09703 (2010).
- P. Rowntree and J. Bolton, Simulation of the atmospheric response to soil moisture anomalies over Europe, Quart. J. Roy. Meteorol. Soc. 109, 501 (1983).
- S. D. Schubert, H. Wang, R. D. Koster, M. J. Suarez, and P. Y. Groisman, Northern eurasian heat waves and droughts, J. Climate 27, 3169 (2014).
- J. Shukla and Y. Mintz, Influence of land-surface evapotranspiration on the Earth's climate, Science 215, 1498 (1982).
- M. Stéfanon, F. D'Andrea, and P. Drobinski, Heatwave classification over Europe and the Mediterranean region, Environ. Res. Lett. 7, 014023 (2012).
- L. Vargas Zeppetello and D. Battisti, Projected increases in monthly midlatitude summertime temperature variance over land are driven by local thermodynamics, Geophys. Res. Lett. 47, e2020GL090197 (2020).
- R. Vautard, P. Yiou, F. D'Andrea, N. de Noblet, N. Viovy, C. Cassou, J. Polcher, P. Ciais, M. Kageyama, and Y. Fan, Summertime European heat and drought waves induced by wintertime Mediterranean rainfall deficit, Geophys. Res. Lett. 34, L07711 (2007).
- L. R. V. Zeppetello, D. S. Battisti, and M. B. Baker, The physics of heat waves: What causes extremely high summertime temperatures? J. Climate 35, 2231 (2022).
- S. Zhou, A. P. Williams, A. M. Berg, B. I. Cook, Y. Zhang, S. Hagemann, R. Lorenz, S. I. Seneviratne, and P. Gentine, Land–atmosphere feedbacks exacerbate concurrent soil drought and atmospheric aridity, Proc. Natl. Acad. Sci. USA 116, 18848 (2019).
- F. Ragone, J. Wouters, and F. Bouchet, Computation of extreme heat waves in climate models using a large deviation algorithm, Proc. Natl. Acad. Sci. USA 115, 24 (2018).
- J. Zscheischler, O. Martius, S. Westra, E. Bevacqua, C. Raymond, R. M. Horton, B. van den Hurk, A. AghaKouchak, A. Jézéquel, and M. D. Mahecha et al., A typology of compound weather and climate events, Nat. Rev. Earth Environ. 1, 333 (2020).
- A. Berg, B. R. Lintner, K. Findell, S. I. Seneviratne, B. van den Hurk, A. Ducharne, F. Chéruy, S. Hagemann, D. M. Lawrence, S. Malyshev, A. Meier, and P. Gentine, Interannual coupling between summertime surface temperature and precipitation over land: Processes and implications for climate change, J. Climate 28, 1308 (2015).
- C. B. Field, V. Barros, T. F. Stocker, and Q. Dahe, Managing the Risks of Extreme Events and Disasters to Advance Climate Change Adaptation: Special Report of the Intergovernmental Panel on Climate Change (Cambridge University Press, Cambridge, UK, 2012).
- G. Branstator and H. Teng, Tropospheric waveguide teleconnections and their seasonality, J. Atmos. Sci. 74, 1513 (2017).
- K. Kornhuber, V. Petoukhov, D. Karoly, S. Petri, S. Rahmstorf, and D. Coumou, Summertime planetary wave resonance in the northern and southern hemispheres, J. Climate 30, 6133 (2017).
- H. Teng and G. Branstator, A zonal wave-number 3 pattern of northern hemisphere wintertime planetary wave variability at high latitudes, J. Climate 25, 6756 (2012).
- H. Teng, G. Branstator, H. Wang, G. A. Meehl, and W. M. Washington, Probability of U.S. heat waves affected by a subseasonal planetary wave pattern, Nat. Geosci. 6, 1056 (2013).
- J. Zscheischler and S. I. Seneviratne, Dependence of drivers affects risks associated with compound events, Sci. Adv. 3, e1700263 (2017).
- A. Tilloy, B. D. Malamud, H. Winter, and A. Joly-Laugel, A review of quantification methodologies for multi-hazard interrelationships, Earth-Sci. Rev. 196, 102881 (2019).
- D. Lucente, F. Bouchet, and C. Herbert, Machine learning of committor functions for predicting high impact climate events, Technical report, Meetings (2020).
- D. Lucente, C. Herbert, and F. Bouchet, Committor functions for climate phenomena at the predictability margin: The example of el niño southern oscillation in the Jin and Timmermann model, J. Atmos. Sci. (2022).
- E. N. Lorenz, The predictability of a flow which possesses many scales of motion, Tellus 21, 289 (1969).
- V. Balaji, Climbing down Charney's ladder: Machine learning and the post-Dennard era of computational climate science, Philos. Trans. R. Soc. A. 379, 20200085 (2021).
- M. Reichstein, G. Camps-Valls, B. Stevens, M. Jung, J. Denzler, N. Carvalhais, and Prabhat, Deep learning and process understanding for data-driven Earth system science, Nature (London) 566, 195 (2019).
- A. Karpatne, G. Atluri, J. H. Faghmous, M. Steinbach, A. Banerjee, A. Ganguly, S. Shekhar, N. Samatova, and V. Kumar, Theory-guided data science: A new paradigm for scientific discovery from data, IEEE Trans. Knowl. Data Eng. 29, 2318 (2017).
- J. Cohen, D. Coumou, J. Hwang, L. Mackey, P. Orenstein, S. Totz, and E. Tziperman, S2S reboot: An argument for greater inclusion of machine learning in subseasonal to seasonal forecasts, WIREs Clim. Change 10, e00567 (2019).
- Y.-G. Ham, J.-H. Kim, and J.-J. Luo, Deep learning for multi-year ENSO forecasts, Nature (London) 573, 568 (2019).
- J. A. Weyn, D. R. Durran, and R. Caruana, Can machines learn to predict weather? Using deep learning to predict gridded 500-hPa geopotential height from historical weather data, J. Adv. Model. Earth Syst. 11, 2680 (2019).
- Y. Liu, E. Racah, J. Correa, A. Khosrowshahi, D. Lavers, K. Kunkel, M. Wehner, W. Collins et al., Application of deep convolutional neural networks for detecting extreme weather in climate datasets, arXiv:1605.01156.
- E. Racah, C. Beckham, T. Maharaj, S. Ebrahimi Kahou, M. Prabhat, and C. Pal, Extremeweather: A large-scale climate dataset for semi-supervised detection, localization, and understanding of extreme weather events, in Advances in Neural Information Processing Systems, edited by I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Curran Associates, Red Hook, NY, 2017), Vol. 30.
- S. Giffard-Roisin, M. Yang, G. Charpiat, C. Kumler Bonfanti, B. Kégl, and C. Monteleoni, Tropical cyclone track forecasting using fused deep learning from aligned reanalysis data, Front. Big Data 3, 1 (2020).
- N. A. Agana and A. Homaifar, A deep learning based approach for long-term drought prediction, in Proceedings of SoutheastCon'17 (2017).
- A. Dikshit, B. Pradhan, and A. M. Alamri, Long lead time drought forecasting using lagged climate variables and a stacked long short-term memory model, Sci. Total Environ. 755, 142638 (2021).
- K. Chen, C. Kuang, L. Wang, K. Chen, X. Han, and J. Fan, Storm surge prediction based on long short-term memory neural network in the East China Sea, Appl. Sci. 12, 181 (2022).
- X. Peng, H. Wang, J. Lang, W. Li, Q. Xu, Z. Zhang, T. Cai, S. Duan, F. Liu, and C. Li, Ealstm-qr: Interval wind-power prediction model based on numerical weather prediction and deep learning, Energy 220, 119692 (2021).
- A. Chattopadhyay, E. Nabizadeh, and P. Hassanzadeh, Analog forecasting of extreme-causing weather patterns using deep learning, J. Adv. Model. Earth Syst. 12, e2019MS001958 (2020).
- V. Jacques-Dumas, F. Ragone, P. Borgnat, P. Abry, and F. Bouchet, Deep learning-based extreme heatwave forecast, Front. Climate 4 (2022).
- M. Mudigonda, P. Ram, K. Kashinath, E. Racah, A. Mahesh, Y. Liu, C. Beckham, J. Biard, T. Kurth, S. Kim, S. Kahou, T. Maharaj, B. Loring, C. Pal, T. O'Brien, K. E. Kunkel, M. F. Wehner, and W. D. Collins, in Deep Learning for Detecting Extreme Weather Patterns (John Wiley and Sons, New York, NY, 2021), Chap. 12, pp. 161–185.
- I. Lopez-Gomez, A. McGovern, S. Agrawal, and J. Hickey, Global extreme heat forecasting using neural weather models, arXiv:2205.10972.
- R. Benedetti, Scoring rules for forecast verification, Monthly Weather Rev. 138, 203 (2010).
- C. van Straaten, K. Whan, D. Coumou, B. van den Hurk, and M. Schmeits, Using explainable machine learning forecasts to discover subseasonal drivers of high summer temperatures in Western and Central Europe, Monthly Weather Rev. 150, 1115 (2022).
- A. Delaunay and H. M. Christensen, Interpretable deep learning for probabilistic MJO prediction, Geophys. Res. Lett. 49, e2022GL098566 (2022).
- A. Fernández, S. García, M. Galar, R. Prati, B. Krawczyk, and F. Herrera, Learning from Imbalanced Data Sets (Springer International Publishing, Cham, 2018).
- A. D. Pozzolo, O. Caelen, R. A. Johnson, and G. Bontempi, Calibrating probability with undersampling for unbalanced classification, in Proceedings of the IEEE Symposium Series on Computational Intelligence (IEEE, Piscataway, NJ, 2015), pp. 159–166.
- K. Fraedrich, E. Kirk, and F. Lunkeit, Puma: Portable university model of the atmosphere, Deutsches Klimarechenzentrum 38 (1998).
- D. Coumou and S. Rahmstorf, A decade of weather extremes, Nat. Climate Change 2, 491 (2012).
- C. Schär, P. L. Vidale, D. Lüthi, C. Frei, C. Häberli, M. A. Liniger, and C. Appenzeller, The role of increasing temperature variability in European summer heatwaves, Nature (London) 427, 332 (2004).
- V. M. Gálfi and V. Lucarini, Fingerprinting Heatwaves and Cold Spells and Assessing their Response to Climate Change Using Large Deviation Theory, Phys. Rev. Lett. 127, 058701 (2021).
- V. M. Gálfi, V. Lucarini, and J. Wouters, A large deviation theory-based analysis of heat waves and cold spells in a simplified model of the general circulation of the atmosphere, J. Stat. Mech. (2019) 033404.
- F. Ragone and F. Bouchet, Computation of extreme values of time averaged observables in climate models with large deviation techniques, J. Stat. Phys. 179, 1637 (2020).
- F. Ragone and F. Bouchet, Rare event algorithm study of extreme warm summers and heatwaves over Europe, Geophys. Res. Lett. 48, e2020GL091197 (2021).
- J. Huang and H. M. van den Dool, Monthly precipitation-temperature relations and temperature prediction over the united states, J. Climate 6, 1111 (1993).
- P. Yiou, Anawege: A weather generator based on analogues of atmospheric circulation, Geosci. Model Dev. 7, 531 (2014).
- P. Yiou and C. Déandréis, Stochastic ensemble climate forecast with an analogue model, Geosci. Model Dev. 12, 723 (2019).
- W. E, and E. Vanden-Eijnden, Transition pathways in complex systems: Reaction coordinates, isocommittor surfaces, and transition tubes, Chem. Phys. Lett. 413, 242 (2005).
- L. Onsager, Initial recombination of ions, Phys. Rev. 54, 554 (1938).
- J. Finkel, D. S. Abbot, and J. Weare, Path properties of Atmospheric Transitions: Illustration with a Low-Order Sudden Stratospheric Warming Model, J. Atmos. Sci. 77, 2327 (2020).
- J. Finkel, R. J. Webber, E. P. Gerber, D. S. Abbot, and J. Weare, Learning forecasts of rare stratospheric transitions from short simulations, Monthly Weather Rev. 149, 3647 (2021).
- D. Lucente, J. Rolland, C. Herbert, and F. Bouchet, Coupling rare event algorithms with data-based learned committor functions using the analogue Markov chain, J. Stat. Mech. (2022) 083201.
- P. Miron, F. Beron-Vera, L. Helfmann, and P. Koltai, Transition paths of marine debris and the stability of the garbage patches, Chaos 31, 033101 (2021).
- Z. D. Pozun, K. Hansen, D. Sheppard, M. Rupp, K.-R. Müller, and G. Henkelman, Optimizing transition states via kernel-based machine learning, J. Chem. Phys. 136, 174101 (2012).
- J. Strahan, A. Antoszewski, C. Lorpaiboon, B. P. Vani, J. Weare, and A. R. Dinner, Long-time-scale predictions from short-trajectory data: A benchmark analysis of the trp-cage miniprotein, J. Chem. Theory Comput. 17, 2948 (2021).
- E. H. Thiede, D. Giannakis, A. R. Dinner, and J. Weare, Galerkin approximation of dynamical quantities using trajectory data, J. Chem. Phys. 150, 244111 (2019).
- S. Manabe, Climate and the ocean circulation: I. The atmosphere circulation and the hydrology of the Earth's surface, Monthly Weather Rev. 97, 739 (1969).
- H. Hersbach, B. Bell, P. Berrisford, S. Hirahara, A. Horányi, J. Muñoz-Sabater, J. Nicolas, C. Peubey, R. Radu, D. Schepers, A. Simmons, C. Soci, S. Abdalla, X. Abellan, G. Balsamo, P. Bechtold, G. Biavati, J. Bidlot, M. Bonavita, G. De Chiara, P. Dahlgren, D. Dee, M. Diamantakis, R. Dragani, J. Flemming, R. Forbes, M. Fuentes, A. Geer, L. Haimberger, S. Healy, R. J. Hogan, E. Hólm, M. Janisková, S. Keeley, P. Laloyaux, P. Lopez, C. Lupu, G. Radnoti, P. de Rosnay, I. Rozum, F. Vamborg, S. Villaume, and J.-N. Thépaut, The ERA5 global reanalysis, Quart. J. Roy. Meteorol. Soc. 146, 1999 (2020).
- P. Mehta, M. Bukov, C.-H. Wang, A. G. Day, C. Richardson, C. K. Fisher, and D. J. Schwab, A high-bias, low-variance introduction to machine learning for physicists, Phys. Rep. 810, 1 (2019).
- I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning (MIT Press, Cambridge, MA, 2016).
- D. Chicco and G. Jurman, The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation, BMC Genom. 21, 1 (2020).
- B. Matthews, Comparison of the predicted and observed secondary structure of T4 phage lysozyme, Biochim. Biophys. Acta Protein Struct. 405, 442 (1975).
- Note1. e.g., Brier depends on unobserved events in multi-class classificaiton problem.
- Statistical forecasting, in Statistical Methods in the Atmospheric Sciences, 4th ed., edited by D. S. Wilks (Elsevier, Amsterdam, 2019), Chap. 7, pp. 235–312.
- G. W. Brier, Verification of forecasts expressed in terms of probability, Monthly Weather Rev. 78, 1 (1950).
- C. Guo, G. Pleiss, Y. Sun, and K. Q. Weinberger, On calibration of modern neural networks, in Proceedings of the 34th International Conference on Machine Learning—Volume 70 (ICML'17) (JMLR.org, 2017), pp. 1321–1330.
- T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd ed., Springer Series in Statistics (Springer, New York, NY, 2009).
- Note2. “Add up” is used here qualitatively, there is no mathematical reason why skills should actually add up arithmetically.
- F. Takens, Detecting strange attractors in turbulence, in Dynamical Systems and Turbulence (Springer, Berlin, 1981), pp. 366–381.
- Note3. In case of 800 years we actually invert validation and training sets that were taken for the benchmark case and perform 10-fold cross validation. In case of 100 years we only sample 10 representative training sets of 100 years and validate on the remainder.
- S. J. Pan and Q. Yang, A survey on transfer learning, IEEE Trans. Knowl. Data Eng. 221345 (2010).
- W. Rawat and Z. Wang, Deep convolutional neural networks for image classification: A comprehensive review, Neural Comput. 29, 2352 (2017).
- J. A. Weyn, D. R. Durran, R. Caruana, and N. Cresswell-Clay, Sub-seasonal forecasting with a large ensemble of deep-learning weather prediction models, J. Adv. Model. Earth Syst. 13, e2021MS002502 (2021).
- https://github.com/georgemilosh/Climate-Learning.
- M. E. Quemener, “SIDUS”, the solution for extreme deduplication of an operating system, Linux J., January (2014).