Sequential Design with Posterior and Posterior Predictive Probabilities

Abstract: Sequential designs drive innovation in clinical, industrial, and corporate settings. Early stopping for failure in sequential designs conserves experimental resources, whereas early stopping for success accelerates access to improved interventions. Bayesian decision procedures provide a formal and intuitive framework for early stopping using posterior and posterior predictive probabilities. Design parameters including decision thresholds and sample sizes are chosen to control the error rates associated with the sequential decision process. These choices are routinely made based on estimating the sampling distribution of posterior summaries via intensive Monte Carlo simulation for each sample size and design scenario considered. In this paper, we propose an efficient method to assess error rates and determine optimal sample sizes and decision thresholds for Bayesian sequential designs. We prove theoretical results that enable posterior and posterior predictive probabilities to be modeled as a function of the sample size. Using these functions, we assess error rates at a range of sample sizes given simulations conducted at only two sample sizes. The effectiveness of our methodology is highlighted using two substantive examples.