Sharp Bounds on the Variance of General Regression Adjustment in Randomized Experiments

Abstract: Building on statistical foundations laid by Neyman [1923] a century ago, a growing literature focuses on problems of causal inference that arise in the context of randomized experiments where the target of inference is the average treatment effect in a finite population and random assignment determines which subjects are allocated to one of the experimental conditions. In this framework, variances of average treatment effect estimators remain unidentified because they depend on the covariance between treated and untreated potential outcomes, which are never jointly observed. Aronow et al. [2014] provide an estimator for the variance of the difference-in-means estimator that is asymptotically sharp. In practice, researchers often use some form of covariate adjustment, such as linear regression when estimating the average treatment effect. Here we extend the Aronow et al. [2014] result, providing asymptotically sharp variance bounds for general regression adjustment. We apply these results to linear regression adjustment and show benefits both in a simulation as well as an empirical application.