Stationary Distributions and Convergence for M/M/1 Queues in Interactive Random Environment

Abstract: A Markovian single-server queue is studied in an interactive random environment. The arrival and service rates of the queue depend on the environment, while the transition dynamics of the random environment depends on the queue length. We consider in detail two types of Markov random environments: a pure jump process and a reflected jump-diffusion. In both cases, the joint dynamics is constructed so that the stationary distribution can be explicitly found in a simple form (weighted geometric). We also derive an explicit estimate for exponential rate of convergence to the stationary distribution via coupling.