Ergodicity Breaking and High-Dimensional Chaos in Random Recurrent Networks

Abstract: The neural model introduced by Sompolinsky, Crisanti, and Sommers (SCS) nearly four decades ago has become a paradigmatic framework for studying complex dynamics in random recurrent networks. In its original formulation, with balanced positive and negative couplings, the model exhibits two phases: a quiescent regime, where all activity ceases, and a regime of ongoing irregular collective activity, termed asynchronous chaos (AC), in which state variables fluctuate strongly in time and across units but average to zero across the network. Building on recent work, we analyze an extension of the SCS model that breaks this coupling balance, yielding a richer phase diagram. In addition to the classical quiescent and AC phases, two additional regimes emerge, marked by spontaneous symmetry breaking. In the persistent-activity (PA) phase, each unit settles into a distinct, stable activation state. In the synchronous-chaotic (SC) phase, dynamics remain irregular and chaotic but fluctuate around a nonzero mean, generating sustained long-time autocorrelations. Using analytical techniques based on dynamical mean-field theory, complemented by extensive numerical simulations, we show how structural disorder gives rise to symmetry and ergodicity breaking. Remarkably, the resulting phase diagram closely parallels that of the Sherrington-Kirkpatrick spin-glass model, with the onset of the SC phase coinciding with the transition associated with replica-symmetry breaking. All key features of spin glasses, including ergodicity breaking, have clear counterparts in this recurrent network context, albeit with crucial idiosyncratic differences, highlighting a unified perspective on complexity in disordered systems.