A hybrid differential game with switching thermostatic-type dynamics and cost

Abstract: In this paper we consider an infinite horizon zero-sum differential game where the dynamics of each player and the running cost are also depending on the evolution of some discrete (switching) variables. In particular, such switching variables evolve according to the switching law of a so-called thermostatic delayed relay, applied to the players' states. We first address the problem of the continuity of both lower and upper value function. Then, by a suitable representation of the problem as a coupling of several exit-time differential games, we characterize those value functions as, respectively, the unique solution of a coupling of several Dirichlet problems for Hamilton-Jacobi-Isaacs equations. The concept of viscosity solutions and a suitable definition of boundary conditions in the viscosity sense is used in the paper. Finally, we give some sufficient conditions for the existence of an equilibrium.