Papers
Topics
Authors
Recent
Search
2000 character limit reached

A tutorial on spatiotemporal partially observed Markov process models via the R package spatPomp

Published 4 Jan 2021 in stat.ME and stat.CO | (2101.01157v4)

Abstract: We describe a computational framework for modeling and statistical inference on high-dimensional stochastic dynamic systems. Our primary motivation is the investigation of metapopulation dynamics arising from a collection of spatially distributed, interacting biological populations. To make progress on this goal, we embed it in a more general problem: inference for a collection of interacting partially observed nonlinear non-Gaussian stochastic processes. Each process in the collection is called a unit; in the case of spatiotemporal models, the units correspond to distinct spatial locations. The dynamic state for each unit may be discrete or continuous, scalar or vector valued. In metapopulation applications, the state can represent a structured population or the abundances of a collection of species at a single location. We consider models where the collection of states has a Markov property. A sequence of noisy measurements is made on each unit, resulting in a collection of time series. A model of this form is called a spatiotemporal partially observed Markov process (SpatPOMP). The R package spatPomp provides an environment for implementing SpatPOMP models, analyzing data using existing methods, and developing new inference approaches. Our presentation of spatPomp reviews various methodologies in a unifying notational framework. We demonstrate the package on a simple Gaussian system and on a nontrivial epidemiological model for measles transmission within and between cities. We show how to construct user-specified SpatPOMP models within spatPomp.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (74)
  1. The data assimilation research testbed: A community facility. Bulletin of the American Meteorological Society, 90(9):1283–1296.
  2. A tutorial on particle filters for online nonlinear, non-Gaussian Bayesian tracking. IEEE Transactions on Signal Processing, 50:174–188.
  3. spatPomp: Statistical Inference for Spatiotemporal Partially Observed Markov Processes. R package version 0.31.0.0.
  4. Digital epidemiology reveals global childhood disease seasonality and the effects of immunization. Proceedings of the National Academy of Sciences of the USA, 113(24):6689–6694.
  5. Estimating enhanced prevaccination measles transmission hotspots in the context of cross-scale dynamics. Proceedings of the National Academy of Sciences, 113(51):14595–14600.
  6. Long-term dynamics of measles in London: Titrating the impact of wars, the 1918 pandemic, and vaccination. PLOS Computational Biology, 15(9):e1007305.
  7. Curse-of-dimensionality revisited: Collapse of the particle filter in very large scale systems. In Speed, T. and Nolan, D., editors, Probability and Statistics: Essays in Honor of David A. Freedman, pages 316–334. Institute of Mathematical Statistics, Beachwood, OH.
  8. Malaria in northwest India: Data analysis via partially observed stochastic differential equation models driven by Lévy noise. Journal of the American Statistical Association, 106:440–451.
  9. Noisy clockwork: Time series analysis of population fluctuations in animals. Science, 293:638–643.
  10. Deciphering the impacts of vaccination and immunity on pertussis epidemiology in Thailand. Proceedings of the National Academy of Sciences of the USA, 110:9595–9600.
  11. Resolving the roles of immunity, pathogenesis, and immigration for rabies persistence in vampire bats. Proceedings of the National Academy of Sciences of the USA.
  12. The role of older children and adults in wild poliovirus transmission. Proceedings of the National Academy of Sciences of the USA, 111(29):10604–10609.
  13. Bretó, C. (2014). On idiosyncratic stochasticity of financial leverage effects. Statistics & Probability Letters, 91:20–26.
  14. Time series analysis via mechanistic models. Annals of Applied Statistics, 3:319–348.
  15. Compound Markov counting processes and their applications to modeling infinitesimally over-dispersed systems. Stochastic Processes and their Applications, 121:2571–2591.
  16. Approximate Bayesian computation for spatial SEIR(S) epidemic models. Spatial and Spatio-temporal Epidemiology, 24:27–37.
  17. Detecting signals of chronic shedding to explain pathogen persistence: Leptospira interrogans in California sea lions. Journal of Animal Ecology, 86(3):460–472.
  18. covatest: An R package for selecting a class of space-time covariance functions. Journal of Statistical Software, 94(1):1–42.
  19. Chambers, J. M. (1998). Programming with Data: A Guide to the S Language. Springer Science & Business Media.
  20. Persistent chaos of measles epidemics in the prevaccination United States caused by a small change in seasonal transmission patterns. PLoS Computational Biology, 12(2):e1004655.
  21. Sequential Monte Carlo with highly informative observations. Journal on Uncertainty Quantification, 3:969–997.
  22. A tutorial on particle filtering and smoothing: Fifteen years later. In Crisan, D. and Rozovsky, B., editors, Oxford Handbook of Nonlinear Filtering. Oxford University Press.
  23. Effects of school closure on incidence of pandemic influenza in Alberta, Canada. Annals of Internal Medicine, 156:173–181.
  24. Evensen, G. (1994). Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. Journal of Geophysical Research: Oceans, 99(C5):10143–10162.
  25. Assimilation of geostat altimeter data for the Agulhas Current using the ensemble Kalman filter with a quasigeostrophic model. Monthly Weather Review, 124:58–96.
  26. A comparison of inferential methods for highly nonlinear state space models in ecology and epidemiology. Statistical Science, 31(1):96–118.
  27. Reproducible parallel inference and simulation of stochastic state space models using odin, dust, and mcstate. Wellcome Open Research, 5.
  28. Genolini, C. (2008). A (not so) short introduction to S4. Technical report, The R-Project for Statistical Computing.
  29. Inferring the causes of the three waves of the 1918 influenza pandemic in England and Wales. Proceedings of the Royal Society of London, Series B, 280:20131345.
  30. Plug-and-play inference for disease dynamics: Measles in large and small towns as a case study. Journal of the Royal Society Interface, 7:271–283.
  31. Bagged filters for partially observed interacting systems. Journal of the American Statistical Association, 118:1078–1089.
  32. Monte Carlo profile confidence intervals for dynamic systems. Journal of the Royal Society Interface, 14:1–10.
  33. Inference for dynamic and latent variable models via iterated, perturbed Bayes maps. Proceedings of the National Academy of Sciences of the USA, 112(3):719––724.
  34. An iterated block particle filter for inference on coupled dynamic systems with shared and unit-specific parameters. Statistica Sinica, pre-published online.
  35. A note on the auxiliary particle filter. Statistics & Probability Letters, 78:1498–1504.
  36. Chopping the tail: How preventing superspreading can help to maintain COVID-19 control. Epidemics, 31:100430.
  37. On particle methods for parameter estimation in state-space models. Statistical Science, 30(3):328–351.
  38. Ensemble Kalman methods for high-dimensional hierarchical dynamic space-time models. Journal of the American Statistical Association, 115(530):866–885.
  39. Inapparent infections and cholera dynamics. Nature, 454:877–880.
  40. Statistical inference for partially observed Markov processes via the R package pomp. Journal of Statistical Software, 69:1–43.
  41. Inference on spatiotemporal dynamics for networks of biological populations. arXiv:2311.06702.
  42. Substantial undocumented infection facilitates the rapid dissemination of novel coronavirus (SARS-CoV-2). Science, 368(6490):489–493.
  43. Lorenz, E. N. (1996). Predictability: A problem partly solved. Proceedings of the Seminar on Predictability, 1:1–18.
  44. Evaluating consumptive and nonconsumptive predator effects on prey density using field time-series data. Ecology, 100(3):e02583.
  45. Unraveling the transmission ecology of polio. PLOS Biology, 13(6):e1002172.
  46. Generalized Linear Models. Chapman and Hall, London, 2nd edition.
  47. Sequential Monte Carlo methods in the nimble and nimbleSMC R packages. Journal of Statistical Software, 100:1–39.
  48. Murray, L. M. (2015). Bayesian state-space modelling on high-performance hardware using LibBi. Journal of Statistical Software, 67(10):1–36.
  49. Factored particles for scalable monitoring. Proceedings of the 18th Conference on Uncertainty and Artificial Intelligence, pages 370–377.
  50. Iterated block particle filter for high-dimensional parameter learning: Beating the curse of dimensionality. Journal of Machine Learning Research, 24(82):1–76.
  51. Using an iterated block particle filter via spatpomp. https://kidusasfaw.github.io/spatPomp/vignettes/ibpf.pdf.
  52. Scalable Monte Carlo inference and rescaled local asymptotic normality. Bernoulli, 27:2532–2555.
  53. Inference on high-dimensional implicit dynamic models using a guided intermediate resampling filter. Statistics & Computing, 30:1497–1522.
  54. Filtering via simulation: Auxillary particle filters. Journal of the American Statistical Association, 94:590–599.
  55. Serotype-specific immunity explains the incidence of diseases caused by human enteroviruses. Science, 361(6404):800–803.
  56. R Core Team (2022a). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria.
  57. R Core Team (2022b). Writing R extensions. R Foundation for Statistical Computing, Vienna, Austria.
  58. Recurring infection with ecologically distinct HPV types can explain high prevalence and diversity. Proceedings of the National Academy of Sciences, page 201714712.
  59. Can local particle filters beat the curse of dimensionality? The Annals of Applied Probability, 25(5):2809–2866.
  60. The potential elimination of Plasmodium vivax malaria by relapse treatment: Insights from a transmission model and surveillance data from NW India. PLOS Neglected Tropical Diseases, 7:e1979.
  61. Identifying the interaction between influenza and pneumococcal pneumonia using incidence data. Science Translational Medicine, 5:191ra84.
  62. Statistical inference for multi-pathogen systems. PLOS Computational Biology, 7:e1002135.
  63. spate: An r package for spatio-temporal modeling with a stochastic advection-diffusion process. Journal of Statistical Software, 63(14):1–23.
  64. Performance bounds for particle filters using the optimal proposal. Monthly Weather Review, 143(11):4750–4761.
  65. Model selection and parameter estimation for dynamic epidemic models via iterated filtering: application to rotavirus in germany. Biostatistics, 21(3):400–416.
  66. Tong, H. (1990). Non-linear Time Series: A Dynamical System Approach. Oxford Science Publ., Oxford.
  67. doParallel: Foreach parallel adaptor for the ’parallel’ package. R package version 1.0.17.
  68. foreach: Provides foreach looping construct. R package version 1.5.2.
  69. Informing policy via dynamic models: Cholera in Haiti. To appear in PLOS Computational Biology.
  70. Wickham, H. (2019). Advanced R. CRC press.
  71. dplyr: A Grammar of Data Manipulation. R package version 1.0.10.
  72. Spatio-temporal Statistics with R. CRC Press.
  73. Measles metapopulation dynamics: A gravity model for epidemiological coupling and dynamics. American Naturalist, 164(2):267–281.
  74. Mechanisms for the circulation of influenza A (H3N2) in China: A spatiotemporal modelling study. PLOS Pathogens, 18(12):e1011046.
Citations (2)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.