Turnpike in optimal control and beyond: a survey

Abstract: The turnpike principle is a fundamental concept in optimal control theory, stating that for a wide class of long-horizon optimal control problems, the optimal trajectory spends most of its time near a steady-state solution (the ''turnpike'') rather than being influenced by the initial or final conditions. In this article, we provide a survey on the turnpike property in optimal control, adding several recent and novel considerations. After some historical insights, we present an elementary proof of the exponential turnpike property for linear-quadratic optimal control problems in finite dimension. Next, we show an extension to nonlinear optimal control problems, with a local exponential turnpike property. On simple but meaningful examples, we illustrate the local and global aspects of the turnpike theory, clarifying the global picture and raising new questions. We discuss key generalizations, in infinite dimension and other various settings, and review several applications of the turnpike theory across different fields.