Papers
Topics
Authors
Recent
Search
2000 character limit reached

SPADE4: Sparsity and Delay Embedding based Forecasting of Epidemics

Published 11 Nov 2022 in cs.LG, physics.soc-ph, and q-bio.PE | (2211.08277v2)

Abstract: Predicting the evolution of diseases is challenging, especially when the data availability is scarce and incomplete. The most popular tools for modelling and predicting infectious disease epidemics are compartmental models. They stratify the population into compartments according to health status and model the dynamics of these compartments using dynamical systems. However, these predefined systems may not capture the true dynamics of the epidemic due to the complexity of the disease transmission and human interactions. In order to overcome this drawback, we propose Sparsity and Delay Embedding based Forecasting (SPADE4) for predicting epidemics. SPADE4 predicts the future trajectory of an observable variable without the knowledge of the other variables or the underlying system. We use random features model with sparse regression to handle the data scarcity issue and employ Takens' delay embedding theorem to capture the nature of the underlying system from the observed variable. We show that our approach outperforms compartmental models when applied to both simulated and real data.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (57)
  1. C. L. Althaus. Estimating the reproduction number of Ebola virus (EBOV) during the 2014 outbreak in West Africa. PLoS currents, 6, 2014.
  2. Learning dynamical systems from partial observations. arXiv preprint arXiv:1902.11136, 2019.
  3. Model reduction and neural networks for parametric PDEs. arXiv preprint arXiv:2005.03180, 2020.
  4. HIV with contact tracing: a case study in approximate Bayesian computation. Biostatistics, 11(4):644–660, 2010.
  5. Extracting qualitative dynamics from experimental data. Physica D: Nonlinear Phenomena, 20(2-3):217–236, 1986.
  6. Chaos as an intermittently forced linear system. Nature Communications, 8(1):1–9, 2017.
  7. Discovering governing equations from data by sparse identification of nonlinear dynamical systems. Proceedings of the National Academy of Sciences, 113(15):3932–3937, 2016.
  8. S. Cauchemez and N. M. Ferguson. Likelihood-based estimation of continuous-time epidemic models from time-series data: application to measles transmission in London. Journal of the Royal Society Interface, 5(25):885–897, 2008.
  9. Discovery of nonlinear multiscale systems: Sampling strategies and embeddings. SIAM Journal on Applied Dynamical Systems, 18(1):312–333, 2019.
  10. Evaluation of individual and ensemble probabilistic forecasts of COVID-19 mortality in the United States. Proceedings of the National Academy of Sciences, 119(15):e2113561119, 2022.
  11. Tracking epidemics with Google flu trends data and a state-space SEIR model. Journal of the American Statistical Association, 107(500):1410–1426, 2012.
  12. P. Girardi and C. Gaetan. An SEIR model with time-varying coefficients for analyzing the SARS-CoV-2 Epidemic. Risk Analysis, 43(1):144–155, 2023.
  13. Identification of distributed parameter systems: A neural net based approach. Computers & Chemical Engineering, 22:S965–S968, 1998.
  14. P. Goyal and P. Benner. Discovery of nonlinear dynamical systems using a Runge–Kutta inspired dictionary-based sparse regression approach. Proceedings of the Royal Society A, 478(2262):20210883, 2022.
  15. Generalization bounds for sparse random feature expansions. Applied and Computational Harmonic Analysis, 62:310–330, 2023.
  16. Direct likelihood-based inference for discretely observed stochastic compartmental models of infectious disease. The Annals of Applied Statistics, 12(3):1993–2021, 2018.
  17. Birth/birth-death processes and their computable transition probabilities with biological applications. Journal of Mathematical Biology, 76(4):911–944, 2018.
  18. J. Huke. Embedding nonlinear dynamical systems: A guide to Takens’ theorem. 2006.
  19. Implicit regularization of random feature models. In International Conference on Machine Learning, pages 4631–4640. PMLR, 2020.
  20. An eigensystem realization algorithm for modal parameter identification and model reduction. Journal of Guidance, Control, and Dynamics, 8(5):620–627, 1985.
  21. Sparse identification of nonlinear dynamics for model predictive control in the low-data limit. Proceedings of the Royal Society A, 474(2219):20180335, 2018.
  22. Time-delay observables for Koopman: Theory and applications. SIAM Journal on Applied Dynamical Systems, 19(2):886–917, 2020.
  23. Artificial neural networks for solving ordinary and partial differential equations. IEEE Transactions on Neural Networks, 9(5):987–1000, 1998.
  24. S. Le Clainche and J. M. Vega. Higher order dynamic mode decomposition. SIAM Journal on Applied Dynamical Systems, 16(2):882–925, 2017.
  25. Fourier neural operator for parametric partial differential equations. arXiv preprint arXiv:2010.08895, 2020.
  26. Parameter inference of time series by delay embeddings and learning differentiable operators. arXiv preprint arXiv:2203.06269, 2022.
  27. Deeponet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators. arXiv preprint arXiv:1910.03193, 2019.
  28. Deepxde: A deep learning library for solving differential equations. SIAM Review, 63(1):208–228, 2021.
  29. Deep learning for universal linear embeddings of nonlinear dynamics. Nature Communications, 9(1):1–10, 2018.
  30. Model selection for dynamical systems via sparse regression and information criteria. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 473(2204):20170009, 2017.
  31. K. S. Narendra and K. Parthasarathy. Neural networks and dynamical systems. International Journal of Approximate Reasoning, 6(2):109–131, 1992.
  32. The random feature model for input-output maps between Banach spaces. SIAM Journal on Scientific Computing, 43(5):A3212–A3243, 2021.
  33. Data driven governing equations approximation using deep neural networks. Journal of Computational Physics, 395:620–635, 2019.
  34. A. Rahimi and B. Recht. Random features for large-scale kernel machines. In NIPS, volume 3, page 5. Citeseer, 2007.
  35. A. Rahimi and B. Recht. Uniform approximation of functions with random bases. In 2008 46th Annual Allerton Conference on Communication, Control, and Computing, pages 555–561. IEEE, 2008.
  36. A. Rahimi and B. Recht. Weighted sums of random kitchen sinks: replacing minimization with randomization in learning. In NIPS, pages 1313–1320. Citeseer, 2008.
  37. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics, 378:686–707, 2019.
  38. SRMD: Sparse random mode decomposition. arXiv preprint arXiv:2204.06108, 2022.
  39. The epidemiology and transmissibility of Zika virus in Girardot and San Andres island, Colombia, September 2015 to January 2016. Eurosurveillance, 21(28):30283, 2016.
  40. A. Rudi and L. Rosasco. Generalization properties of learning with random features. In NIPS, pages 3215–3225, 2017.
  41. Data-driven discovery of partial differential equations. Science Advances, 3(4):e1602614, 2017.
  42. HARFE: Hard-ridge random feature expansion. arXiv preprint arXiv:2202.02877, 2022.
  43. H. Schaeffer. Learning partial differential equations via data discovery and sparse optimization. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 473(2197):20160446, 2017.
  44. Extracting sparse high-dimensional dynamics from limited data. SIAM Journal on Applied Mathematics, 78(6):3279–3295, 2018.
  45. Implicit neural representations with periodic activation functions. Advances in Neural Information Processing Systems, 33:7462–7473, 2020.
  46. Forecasting epidemics through nonparametric estimation of time-dependent transmission rates using the SEIR model. Bulletin of Mathematical Biology, 81:4343–4365, 2019.
  47. Deep learning of biological models from data: applications to ODE models. Bulletin of Mathematical Biology, 83(3):1–19, 2021.
  48. Deep learning of biological models from data: applications to ODE models. Bulletin of Mathematical Biology, 83:1–19, 2021.
  49. F. Takens. Detecting strange attractors in turbulence. In Dynamical Systems and Turbulence, Warwick 1980: proceedings of a symposium held at the University of Warwick 1979/80, pages 366–381. Springer, 2006.
  50. G. Tran and R. Ward. Exact recovery of chaotic systems from highly corrupted data. Multiscale Modeling & Simulation, 15(3):1108–1129, 2017.
  51. G. Uribarri and G. B. Mindlin. Dynamical time series embeddings in recurrent neural networks. Chaos, Solitons & Fractals, 154:111612, 2022.
  52. Data-driven forecasting of high-dimensional chaotic systems with long short-term memory networks. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 474(2213):20170844, 2018.
  53. E. Weinan. A proposal on machine learning via dynamical systems. Communications in Mathematics and Statistics, 1(5):1–11, 2017.
  54. A comparative analysis of optimization and generalization properties of two-layer neural network and random feature models under gradient descent dynamics. Sci. China Math, 2019.
  55. Shrimp: Sparser random feature models via iterative magnitude pruning. In Mathematical and Scientific Machine Learning, pages 303–318. PMLR, 2022.
  56. Exact gap between generalization error and uniform convergence in random feature models. In International Conference on Machine Learning, pages 11704–11715. PMLR, 2021.
  57. Epidemic model guided machine learning for COVID-19 forecasts in the United States. MedRxiv, 2020.
Citations (5)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Authors (3)

Collections

Sign up for free to add this paper to one or more collections.