Regularized dynamical parametric approximation
Abstract: This paper studies the numerical approximation of evolution equations by nonlinear parametrizations $u(t)=\Phi(q(t))$ with time-dependent parameters $q(t)$, which are to be determined in the computation. The motivation comes from approximations in quantum dynamics by multiple Gaussians and approximations of various dynamical problems by tensor networks and neural networks. In all these cases, the parametrization is typically irregular: the derivative $\Phi'(q)$ can have arbitrarily small singular values and may have varying rank. We derive approximation results for a regularized approach in the time-continuous case as well as in time-discretized cases. With a suitable choice of the regularization parameter and the time stepsize, the approach can be successfully applied in irregular situations, even though it runs counter to the basic principle in numerical analysis to avoid solving ill-posed subproblems when aiming for a stable algorithm. Numerical experiments with sums of Gaussians for approximating quantum dynamics and with neural networks for approximating the flow map of a system of ordinary differential equations illustrate and complement the theoretical results.
- Physics informed neural networks (PINNs) for approximating nonlinear dispersive PDEs. J. Comput. Math., 39(6):816–847, 2021.
- Solving the Kolmogorov PDE by means of deep learning. J. Sci. Comput., 88(3):Paper No. 73, 28, 2021.
- Neural Galerkin schemes with active learning for high-dimensional evolution equations. J. Comput. Phys., 496:Paper No. 112588, 22, 2024.
- G. Carleo and M. Troyer. Solving the quantum many-body problem with artificial neural networks. Science, 355(6325):602–606, 2017.
- Time integration of tree tensor networks. SIAM J. Numer. Anal., 59(1):289–313, 2021.
- P. A. Dirac. Note on exchange phenomena in the Thomas atom. Proc. Cambridge Phil. Soc., 26(3):376–385, 1930.
- Y. Du and T. A. Zaki. Evolutional deep neural network. Phys. Rev. E, 104(4):Paper No. 045303, 14, 2021.
- Unifying time evolution and optimization with matrix product states. Phys. Rev. B, 94(16):165116, 2016.
- Solving Ordinary Differential Equations I. Nonstiff Problems. Springer, Berlin, 2nd edition, 1993.
- E. Hairer and G. Wanner. Solving Ordinary Differential Equations II. Stiff and Differential-Algebraic Problems. Springer, Berlin, 2nd edition, 1996.
- M. J. Hartmann and G. Carleo. Neural-network approach to dissipative quantum many-body dynamics. Phys. Rev. Letters, 122(25):250502, 2019.
- L. Joubert-Doriol. Variational approach for linearly dependent moving bases in quantum dynamics: Application to gaussian functions. Journal of Chemical Theory and Computation, 18(10):5799–5809, 2022.
- Choosing regularization parameters in iterative methods for ill-posed problems. SIAM J. Matrix Anal. Appl., 22(4):1204–1221, 2001.
- Neural operator: Learning maps between function spaces with applications to PDEs. J. Machine Learning Res., 24(89):1–97, 2023.
- P. Kramer and M. Saraceno. Geometry of the time-dependent variational principle in quantum mechanics, volume 140 of Lecture Notes in Physics. Springer, Berlin, 1981.
- A theoretical analysis of deep neural networks and parametric PDEs. Constr. Approx., 55:73–125, 2022.
- C. Lubich. From quantum to classical molecular dynamics: reduced models and numerical analysis. European Mathematical Society, 2008.
- Time integration of tensor trains. SIAM J. Numer. Anal., 53(2):917–941, 2015.
- The multi-configurational time-dependent Hartree approach. Chem. Phys. Letters, 165(1):73–78, 1990.
- S. Mishra and R. Molinaro. Estimates on the generalization error of physics-informed neural networks for approximating PDEs. IMA J. Numer. Anal., 43(1):1–43, 2023.
- J. J. Moré. The Levenberg–Marquardt algorithm: implementation and theory. In Numerical analysis: proceedings of the biennial Conference held at Dundee, June 28–July 1, 1977, pages 105–116. Springer, 2006.
- Deep ReLU networks and high-order finite element methods. Anal. Appl. (Singap.), 18(5):715–770, 2020.
- Quantum dynamics simulations using Gaussian wavepackets: the vMCG method. Int. Rev. Phys. Chem., 34(2):269–308, 2015.
- M. Schmitt and M. Heyl. Quantum many-body dynamics in two dimensions with artificial neural networks. Phys. Rev. Letters, 125(10):100503, 2020.
- Classical simulation of quantum many-body systems with a tree tensor network. Phys. Rev. A, 74(2):022320, 2006.
- A. Townsend and L. N. Trefethen. Continuous analogues of matrix factorizations. Proc. Royal Soc. A: Math. Phys. Eng. Sci., 471(2173):20140585, 2015.
- H. Wang and M. Thoss. Multilayer formulation of the multiconfiguration time-dependent Hartree theory. J. Chem. Phys., 119(3):1289–1299, 2003.
- A novel algorithm for non-adiabatic direct dynamics using variational Gaussian wavepackets. Faraday discussions, 127:307–323, 2004.
- B. Yu and W. E. The deep Ritz method: a deep learning-based numerical algorithm for solving variational problems. Comm. Math. Stat., 6(1):1–12, 2018.
- Weak adversarial networks for high-dimensional partial differential equations. J. Comput. Phys., 411:109409, 14, 2020.
- Physics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled data. J. Comput. Phys., 394:56–81, 2019.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.