Statistical Equilibrium of Optimistic Beliefs

Abstract: We introduce the Statistical Equilibrium of Optimistic Beliefs (SE-OB) for the mixed extension of finite normal-form games, drawing insights from discrete choice theory. Departing from the conventional best responders of Nash equilibrium and the better responders of quantal response equilibrium, we reconceptualize player behavior as that of optimistic better responders. In this setting, the players assume that their expected payoffs are subject to random perturbations, and form optimistic beliefs by selecting the distribution of perturbations that maximizes their highest anticipated payoffs among belief sets. In doing so, SE-OB subsumes and extends the existing equilibria concepts. The player's view of the existence of perturbations in their payoffs reflects an inherent risk sensitivity, and thus, each player is equipped with a risk-preference function for every action. We demonstrate that every Nash equilibrium of a game, where expected payoffs are regularized with the risk-preference functions of the players, corresponds to an SE-OB in the original game, provided that the belief sets coincide with the feasible set of a multi-marginal optimal transport problem with marginals determined by risk-preference functions. Building on this connection, we propose an algorithm for repeated games among risk-sensitive players under optimistic beliefs when only zeroth-order feedback is available. We prove that, under appropriate conditions, the algorithm converges to an SE-OB. Our convergence analysis offers key insights into the strategic behaviors for equilibrium attainment: a player's risk sensitivity enhances equilibrium stability, while forming optimistic beliefs in the face of ambiguity helps to mitigate overly aggressive strategies over time. As a byproduct, our approach delivers the first generic convergent algorithm for general-form structural QRE beyond the classical logit-QRE.