Papers
Topics
Authors
Recent
Search
2000 character limit reached

A Koopman-Takens theorem: Linear least squares prediction of nonlinear time series

Published 4 Aug 2023 in math.DS and math.FA | (2308.02175v3)

Abstract: The least squares linear filter, also called the Wiener filter, is a popular tool to predict the next element(s) of time series by linear combination of time-delayed observations. We consider observation sequences of deterministic dynamics, and ask: Which pairs of observation function and dynamics are predictable? If one allows for nonlinear mappings of time-delayed observations, then Takens' well-known theorem implies that a set of pairs, large in a specific topological sense, exists for which an exact prediction is possible. We show that a similar statement applies for the linear least squares filter in the infinite-delay limit, by considering the forecast problem for invertible measure-preserving maps and the Koopman operator on square-integrable functions.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (81)
  1. H. Arbabi and I. Mezić. Ergodic theory, dynamic mode decomposition, and computation of spectral properties of the Koopman operator. SIAM Journal on Applied Dynamical Systems, 16(4):2096–2126, 2017.
  2. S. Alpern and V. S. Prasad. Typical dynamics of volume preserving homeomorphisms, volume 139. Cambridge University Press, 2000.
  3. Chaos as an intermittently forced linear system. Nature communications, 8(1):19, 2017.
  4. Discovering governing equations from partial measurements with deep delay autoencoders. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 479(2276):20230422, 2023.
  5. A probabilistic Takens theorem. Nonlinearity, 33(9):4940–4966, 2020.
  6. On the Shroer-Sauer-Ott-Yorke predictability conjecture for time-delay embeddings. Commun. Math. Phys., 391:609–641, 2022.
  7. Prediction of dynamical systems from time-delayed measurements with self-intersections. arXiv preprint arXiv:2212.13509, 2022.
  8. Extracting qualitative dynamics from experimental data. Physica D: Nonlinear Phenomena, 20(2-3):217–236, 1986.
  9. V. I. Bogachev. Measure theory. Vol. I, II. Springer-Verlag, Berlin, 2007.
  10. J. Bröcker. Reliability, sufficiency, and the decomposition of proper scores. Q. J. R. Meteorol. Soc., 135:1512–1519, 2009.
  11. Subsequence bounded rational ergodicity of rank-one transformations. Dynamical Systems, 30:70–84, 2015.
  12. Residual dynamic mode decomposition: robust and verified Koopmanism. Journal of Fluid Mechanics, 955:A21, 2023.
  13. A mathematical framework for quantifying predictability through relative entropy. Methods Appl. Anal., 9(3):425–444, 2002.
  14. M. J. Colbrook. The mpEDMD algorithm for data-driven computations of measure-preserving dynamical systems. SIAM Journal on Numerical Analysis, 61(3):1585–1608, 2023.
  15. M. J. Colbrook and A. Townsend. Rigorous data-driven computation of spectral properties of Koopman operators for dynamical systems. Communications on Pure and Applied Mathematics, 77(1):221–283, 2024.
  16. S. Das and D. Giannakis. Delay-coordinate maps and the spectra of Koopman operators. Journal of Statistical Physics, 175(6):1107–1145, 2019.
  17. On the computation of attractors for delay differential equations. Journal of Computational Dynamics, 3(1):93–112, 2016.
  18. A. Del Junco. Transformations with discrete spectrum are stacking transformations. Canadian Journal of Mathematics, 28(4):836–839, 1976.
  19. R. Duncan. Some pointwise convergence results in Lp⁢(μ)superscript𝐿𝑝𝜇{L}^{p}(\mu)italic_L start_POSTSUPERSCRIPT italic_p end_POSTSUPERSCRIPT ( italic_μ ), 1<p<∞1𝑝1<p<\infty1 < italic_p < ∞. Canad. Math. Bull, 20:3, 1977.
  20. Operator theoretic aspects of ergodic theory, volume 272. Springer, 2015.
  21. One-parameter semigroups for linear evolution equations, volume 194. Springer, 2000.
  22. S. Ferenczi. Systems of finite rank. In Colloquium Mathematicae, volume 73, pages 35–65, 1997.
  23. Predicting chaotic time series. Phys. Rev. Lett., 59:845–848, Aug 1987.
  24. Kernel-based prediction of non-Markovian time series. Physica D: Nonlinear Phenomena, 418:132829, 2021.
  25. Lyapunov exponents of two stochastic Lorenz 63 systems. Journal of Statistical Physics, 179:1343–1365, 2020.
  26. D. Giannakis. Delay-coordinate maps, coherence, and approximate spectra of evolution operators. Research in the Mathematical Sciences, 8(1):8, 2021.
  27. A priori estimation of memory effects in reduced-order models of nonlinear systems using the Mori–Zwanzig formalism. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 473(2205):20170385, 2017.
  28. T. Gneiting and A. Raftery. Strictly proper scoring rules, prediction, and estimation. Journal of the American Statistical Association, 102(477):359–378, 2007.
  29. G. A. Gottwald and S. Reich. Combining machine learning and data assimilation to forecast dynamical systems from noisy partial observations. Chaos: An Interdisciplinary Journal of Nonlinear Science, 31(10):101103, 2021.
  30. G. A. Gottwald and S. Reich. Supervised learning from noisy observations: Combining machine-learning techniques with data assimilation. Physica D: Nonlinear Phenomena, 423:132911, 2021.
  31. Y. Gutman. Takens’ embedding theorem with a continuous observable. In Ergodic Theory: Advances in Dynamical Systems, pages 134–141. De Gruyter, Berlin-Boston, 2016.
  32. P. R. Halmos. Lectures on ergodic theory. Courier Dover Publications, 2017.
  33. Predicting chaotic time series with a partial model. Phys. Rev. E, 92:010902, Jul 2015.
  34. Distinguishing random environmental fluctuations from ecological catastrophes for the North Pacific Ocean. Nature, 435:336–340, 2005.
  35. J. P. Huke. Embedding nonlinear dynamical systems: A guide to takens’ theorem. 2006.
  36. Time-delay observables for Koopman: Theory and applications. SIAM Journal on Applied Dynamical Systems, 19(2):886–917, 2020.
  37. M. Korda and I. Mezić. On convergence of extended dynamic mode decomposition to the Koopman operator. Journal of Nonlinear Science, 28:687–710, 2018.
  38. A. Kolmogorov. Interpolation and extrapolation of stationary random sequences. Izvestiya Rossiiskoi Akademii Nauk. Seriya Matematicheskaya, 5:3, 1941.
  39. A. Kolmogorov. Stationary sequences in Hilbert space. Bull. Math. Univ., Moscou, 2, 1941.
  40. B. O. Koopman. Hamiltonian systems and transformation in Hilbert space. Proceedings of the National Academy of Sciences, 17(5):315–318, 1931.
  41. Data-driven spectral analysis of the Koopman operator. Applied and Computational Harmonic Analysis, 48(2):599–629, 2020.
  42. E. Kreyszig. Introductory functional analysis with applications, volume 17. John Wiley & Sons, 1991.
  43. A. Katok and A. Stepin. Approximations in ergodic theory. Uspehi Mat. Nauk, pages 81–106, 1967.
  44. A. Katok and J.-P. Thouvenot. Spectral properties and combinatorial constructions in ergodic theory. In Handbook of dynamical systems, volume 1B, pages 649–743, 2006.
  45. Dynamical systems of continuous spectra. Proceedings of the National Academy of Sciences, 18(3):255–263, 1932.
  46. E. Kostelich and J. Yorke. Noise reduction: Finding the simplest dynamical system consistent with the data. Physica D: Nonlinear Phenomena, 41(2):183–196, 1990.
  47. A. Lapedes and R. Farber. Nonlinear signal processing using neural networks: Prediction and system modelling. Technical report, 1987.
  48. K. K. Lin and F. Lu. Data-driven model reduction, Wiener projections, and the Koopman–Mori–Zwanzig formalism. Journal of Computational Physics, 424:109864, 2021.
  49. The Lorenz attractor is mixing. Communications in Mathematical Physics, 260:393–401, 2005.
  50. Regression-based projection for learning Mori–-Zwanzig operators. SIAM Journal on Applied Dynamical Systems, 22(4):2890–2926, 2023.
  51. I. Mezić. On numerical approximations of the Koopman operator. Mathematics, 10(7):1180, 2022.
  52. I. Melbourne and G. A. Gottwald. Power spectra for deterministic chaotic dynamical systems. Nonlinearity, 21(1):179, 2007.
  53. Nonlinear dynamics and noise in fisheries recruitment: a global meta-analysis. Fish and Fisheries, 19:964–973, 2018.
  54. H. Mori. Transport, collective motion, and Brownian motion. Progress of Theoretical Physics, 33(3):423–455, 03 1965.
  55. M. Nadkarni. Spectral Theory of Dynamical Systems. Springer Singapore, 2nd edition, 2020.
  56. Geometry from a time series. Physical Review Letters, 45(9):712, 1980.
  57. F. Philipp. Bessel orbits of normal operators. J. Math. Anal. Appl., 448(2):767–785, 2017.
  58. Spectral analysis for physical applications. Cambridge University Press, 1993.
  59. Spectral analysis of nonlinear flows. Journal of fluid mechanics, 641:115–127, 2009.
  60. J. C. Robinson. A topological delay embedding theorem for infinite-dimensional dynamical systems. Nonlinearity, 18(5):2135–2143, 2005.
  61. J. C. Robinson. Dimensions, Embeddings, and Attractors. Cambridge Tracts in Mathematics. Cambridge University Press, 2010.
  62. W. Rudin. Real and Complex Analysis. McGraw-Hill Book Co., 3rd edition, 1987.
  63. Distinguishing error from chaos in ecological time series. Philosophical Transactions: Biological Sciences, 330(1257):235–251, 1990.
  64. B. Simon. Szegő’s theorem and its descendants. Princeton University Press, 2010.
  65. G. Sugihara and R. May. Nonlinear forecasting as a way of distinguishing chaos from measurement error in time series. Nature, 344:734–741, 1990.
  66. P. J. Schmid and J. Sesterhenn. Dynamic mode decomposition of numerical and experimental data. In Bull. Amer. Phys. Soc., volume 61, 2008.
  67. Embedology. Journal of Statistical Physics, 65(3):579–616, 1991.
  68. F. Takens. Detecting strange attractors in turbulence. In Dynamical Systems and Turbulence, Warwick 1980, volume 898 of Lecture Notes in Math., pages 366–381. Springer, Berlin-New York, 1981.
  69. F. Takens. The reconstruction theorem for endomorphisms. Bull. Braz. Math. Soc. (N.S.), 33(2):231–262, 2002.
  70. M. Taylor. Partial differential equations II: Qualitative studies of linear equations, volume 116. Springer Science & Business Media, 2013.
  71. L. N. Trefethen and M. Embree. Spectra and pseudospectra: the behavior of nonnormal matrices and operators. Princeton University Press, 2005.
  72. C. Valva and D. Giannakis. Consistent spectral approximation of Koopman operators using resolvent compactification. arXiv preprint arXiv:2309.00732, 2023.
  73. J. von Neumann. Zur Operatorenmethode in der klassischen Mechanik. Annals of Mathematics, pages 587–642, 1932.
  74. H. U. Voss. Synchronization of reconstructed dynamical systems. Chaos, 13:327–334, 2003.
  75. P. Walters. An introduction to ergodic theory, volume 79. Springer Science & Business Media, 2000.
  76. Z. Wang and C. Guet. Self-consistent learning of neural dynamical systems from noisy time series. IEEE Transactions on Emerging Topics in Computational Intelligence, 6(5):1103–1112, 2022.
  77. N. Wiener. Extrapolation, interpolation, and smoothing of stationary time series, volume 113. The MIT Press, 1949.
  78. A data–driven approximation of the Koopman operator: Extending dynamic mode decomposition. Journal of Nonlinear Science, 25:1307–1346, 2015.
  79. Data-driven modelling of nonlinear dynamics by barycentric coordinates and memory. arXiv preprint arXiv:2112.06742, 2021.
  80. Deep learning delay coordinate dynamics for chaotic attractors from partial observable data. Physical Review E, 107(3):034215, 2023.
  81. R. Zwanzig. Statistical mechanics of irreversibility. In W. Brittin, editor, Lectures in Theoretical Physiscs, volume 3. Wiley-Interscience, New York, NY, USA, 1961.
Citations (3)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Authors (2)

  1. Péter Koltai 
  2. Philipp Kunde 

Collections

Sign up for free to add this paper to one or more collections.

Sign Up