2000 character limit reached
LyZNet: A Lightweight Python Tool for Learning and Verifying Neural Lyapunov Functions and Regions of Attraction
Published 15 Mar 2024 in eess.SY, cs.LG, cs.SY, and math.OC | (2403.10013v1)
Abstract: In this paper, we describe a lightweight Python framework that provides integrated learning and verification of neural Lyapunov functions for stability analysis. The proposed tool, named LyZNet, learns neural Lyapunov functions using physics-informed neural networks (PINNs) to solve Zubov's equation and verifies them using satisfiability modulo theories (SMT) solvers. What distinguishes this tool from others in the literature is its ability to provide verified regions of attraction close to the domain of attraction. This is achieved by encoding Zubov's partial differential equation (PDE) into the PINN approach. By embracing the non-convex nature of the underlying optimization problems, we demonstrate that in cases where convex optimization, such as semidefinite programming, fails to capture the domain of attraction, our neural network framework proves more successful. The tool also offers automatic decomposition of coupled nonlinear systems into a network of low-dimensional subsystems for compositional verification. We illustrate the tool's usage and effectiveness with several numerical examples, including both non-trivial low-dimensional nonlinear systems and high-dimensional systems. The repository of the tool can be found at https://git.uwaterloo.ca/hybrid-systems-lab/lyznet.
- FOSSIL: a software tool for the formal synthesis of Lyapunov functions and barrier certificates using neural networks. In Proceedings of the International Conference on Hybrid Systems: Computation and Control. 1–11.
- Formal synthesis of Lyapunov neural networks. IEEE Control Systems Letters 5, 3 (2020), 773–778.
- Automated and sound synthesis of Lyapunov functions with SMT solvers. In Proc. of TACAS. Springer, 97–114.
- Neural Lyapunov control. Advances in Neural Information Processing Systems 32 (2019).
- Learning Lyapunov functions for hybrid systems. In Proceedings of the International Conference on Hybrid Systems: Computation and Control. 1–11.
- Learning region of attraction for nonlinear systems. In Proceedings of the IEEE Conference on Decision and Control. IEEE, 6477–6484.
- Counter-example guided synthesis of neural network Lyapunov functions for piecewise linear systems. In Proc. of CDC. 1274–1281.
- Lyapunov-stable neural-network control. In Proc. of RSS.
- Safe control with learned certificates: A survey of neural Lyapunov, barrier, and contraction methods for robotics and control. IEEE Transactions on Robotics (2023).
- Leonardo De Moura and Nikolaj Bjørner. 2008. Z3: An efficient SMT solver. In Proc. of TACAS. Springer, 337–340.
- Fossil 2.0: Formal Certificate Synthesis for the Verification and Control of Dynamical Models. arXiv preprint arXiv:2311.09793 (2023).
- Lyapunov-Net: A deep neural network architecture for Lyapunov function approximation. In Proceedings of the IEEE Conference on Decision and Control. IEEE, 2091–2096.
- dReal: an SMT solver for nonlinear theories over the reals. In Proceedings of International Conference on Automated Deduction. 208–214.
- Peter Giesl. 2007. Construction of Global Lyapunov Functions Using Radial Basis Functions. Vol. 1904. Springer.
- Peter Giesl and Sigurdur Hafstein. 2015. Review on computational methods for Lyapunov functions. Discrete & Continuous Dynamical Systems-B 20, 8 (2015), 2291.
- Lars Grüne. 2021a. Computing Lyapunov functions using deep neural networks. Journal of Computational Dynamics 8, 2 (2021).
- Lars Grüne. 2021b. Overcoming the curse of dimensionality for approximating Lyapunov functions with deep neural networks under a small-gain condition. IFAC-PapersOnLine 54, 9 (2021), 317–322.
- Wassim M Haddad and VijaySekhar Chellaboina. 2008. Nonlinear Dynamical Systems and Control: A Lyapunov-based Approach. Princeton University Press.
- Array programming with NumPy. Nature 585, 7825 (2020), 357–362.
- Joblib Development Team. 2023. Joblib: running Python functions as pipeline jobs. https://joblib.readthedocs.io/
- Morgan Jones and Matthew M Peet. 2021. Converse Lyapunov functions and converging inner approximations to maximal regions of attraction of nonlinear systems. In Proc. of CDC. IEEE, 5312–5319.
- Data-Driven Computational Methods for the Domain of Attraction and Zubov’s Equation. IEEE Trans. Automat. Control (2023).
- Simulation-guided Lyapunov analysis for hybrid dynamical systems. In Proc. of HSCC. 133–142.
- Estimation of region of attraction for polynomial nonlinear systems: A numerical method. ISA Transactions 53, 1 (2014), 25–32.
- Artificial neural networks for solving ordinary and partial differential equations. IEEE Transactions on Neural Networks 9, 5 (1998), 987–1000.
- Physics-Informed Neural Network Lyapunov Functions: PDE Characterization, Learning, and Verification. arXiv preprint arXiv:2312.09131 (2023).
- Towards Learning and Verifying Maximal Neural Lyapunov Functions. In Proceedings of IEEE Conference on Decision and Control.
- Compositionally Verifiable Vector Neural Lyapunov Functions for Stability Analysis of Interconnected Nonlinear Systems. In Proc. of ACC.
- LyZNet with Control: Physics-Informed Neural Network Control of Nonlinear Systems with Formal Guarantees. In Proceedings of the 8th IFAC Conference on Analysis and Design of Hybrid Systems.
- Y. Long and M.M. Bayoumi. 1993. Feedback stabilization: control Lyapunov functions modelled by neural networks. In Proc. of CDC. 2812–2814 vol.3.
- Aleksandr Mikhailovich Lyapunov. 1992. The general problem of the stability of motion. Internat. J. Control 55, 3 (1992), 531–534.
- Learning Regions of Attraction in Unknown Dynamical Systems via Zubov-Koopman Lifting: Regularities and Convergence. arXiv preprint arXiv:2311.15119 (2023).
- Zubov-Koopman Learning of Maximal Lyapunov Functions. In Proceedings of American Control Conference.
- Physics-Informed Neural Network Policy Iteration: Algorithms, Convergence, and Verification. arXiv preprint (2024).
- SymPy: symbolic computing in Python. PeerJ Computer Science 3 (2017), e103.
- Help on SOS. IEEE Control Systems Magazine 30, 4 (2010), 18–23.
- Antonis Papachristodoulou and Stephen Prajna. 2002. On the construction of Lyapunov functions using the sum of squares decomposition. In Proceedings of IEEE Conference on Decision and Control, Vol. 3. IEEE, 3482–3487.
- Antonis Papachristodoulou and Stephen Prajna. 2005. A tutorial on sum of squares techniques for systems analysis. In Proc. of ACC. IEEE, 2686–2700.
- Pytorch: An imperative style, high-performance deep learning library. Advances in Neural Information Processing Systems 32 (2019).
- Danil V Prokhorov. 1994. A Lyapunov machine for stability analysis of nonlinear systems. In Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN’94), Vol. 2. IEEE, 1028–1031.
- Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational physics 378 (2019), 686–707.
- Constructive Nonlinear Control. Springer Science & Business Media.
- Weehong Tan and Andrew Packard. 2008. Stability region analysis using polynomial and composite polynomial Lyapunov functions and sum-of-squares programming. IEEE Trans. Automat. Control 53, 2 (2008), 565–571.
- Local stability analysis using simulations and sum-of-squares programming. Automatica 44, 10 (2008), 2669–2675.
- Anthony Vannelli and Mathukumalli Vidyasagar. 1985. Maximal Lyapunov functions and domains of attraction for autonomous nonlinear systems. Automatica 21, 1 (1985), 69–80.
- SciPy 1.0: fundamental algorithms for scientific computing in Python. Nature Methods 17, 3 (2020), 261–272.
- Neural Lyapunov Control of Unknown Nonlinear Systems with Stability Guarantees. In Advances in Neural Information Processing Systems.
- V. I. Zubov. 1964. Methods of A. M. Lyapunov and Their Application. Noordhoff.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.