Intervention effects based on potential benefit
Abstract: Optimal treatment rules are mappings from individual patient characteristics to tailored treatment assignments that maximize mean outcomes. In this work, we introduce a conditional potential benefit (CPB) metric that measures the expected improvement under an optimally chosen treatment compared to the status quo, within covariate strata. The potential benefit combines (i) the magnitude of the treatment effect, and (ii) the propensity for subjects to naturally select a suboptimal treatment. As a consequence, heterogeneity in the CPB can provide key insights into the mechanism by which a treatment acts and/or highlight potential barriers to treatment access or adverse effects. Moreover, we demonstrate that CPB is the natural prioritization score for individualized treatment policies when intervention capacity is constrained. That is, in the resource-limited setting where treatment options are freely accessible, but the ability to intervene on a portion of the target population is constrained (e.g., if the population is large, and follow-up and encouragement of treatment uptake is labor-intensive), targeting subjects with highest CPB maximizes the mean outcome. Focusing on this resource-limited setting, we derive formulas for optimal constrained treatment rules, and for any given budget, quantify the loss compared to the optimal unconstrained rule. We describe sufficient identification assumptions, and propose nonparametric, robust, and efficient estimators of the proposed quantities emerging from our framework. Finally, we illustrate our methodology using data from a prospective cohort study in which we assess the impact of intensive care unit transfer on mortality.
- Audibert, J.-Y. and Tsybakov, A. B. (2007), “Fast learning rates for plug-in classifiers,” The Annals of Statistics, 35, 608–633.
- Ben-Michael, E., Imai, K., and Jiang, Z. (2024), “Policy Learning with Asymmetric Counterfactual Utilities,” Journal of the American Statistical Association, 0, 1–14.
- Bickel, P. J. and Ritov, Y. (1988), “Estimating integrated squared density derivatives: sharp best order of convergence estimates,” Sankhyā: The Indian Journal of Statistics, Series A, 381–393.
- Bonvini, M. and Kennedy, E. H. (2022), “Sensitivity analysis via the proportion of unmeasured confounding,” Journal of the American Statistical Association, 117, 1540–1550.
- Brand, J. E. and Xie, Y. (2010), “Who benefits most from college? Evidence for negative selection in heterogeneous economic returns to higher education,” American sociological review, 75, 273–302.
- Carneiro, P., Hansen, K. T., and Heckman, J. J. (2003), “Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College,” .
- Carneiro, P., Heckman, J., and Vytlacil, E. (2001), “Estimating the return to education when it varies among individuals,” Tech. rep., mimeo.
- Carneiro, P., Heckman, J. J., and Vytlacil, E. J. (2011), “Estimating marginal returns to education,” American Economic Review, 101, 2754–2781.
- Chakraborty, B. and Moodie, E. E. (2013), “Statistical methods for dynamic treatment regimes,” Springer-Verlag, 10, 978–1.
- Chernozhukov, V., Chetverikov, D., Demirer, M., Duflo, E., Hansen, C., Newey, W., and Robins, J. (2018), “Double/debiased machine learning for treatment and structural parameters,” .
- Cole, S. R. and Stuart, E. A. (2010), “Generalizing evidence from randomized clinical trials to target populations: the ACTG 320 trial,” American journal of epidemiology, 172, 107–115.
- D’Adamo, R. (2021), “Orthogonal Policy Learning Under Ambiguity,” arXiv preprint arXiv:2111.10904.
- Dahabreh, I. J., Petito, L. C., Robertson, S. E., Hernán, M. A., and Steingrimsson, J. A. (2020), “Towards causally interpretable meta-analysis: transporting inferences from multiple randomized trials to a new target population,” Epidemiology (Cambridge, Mass.), 31, 334.
- Foster, D. J. and Syrgkanis, V. (2023), “Orthogonal statistical learning,” The Annals of Statistics, 51, 879–908.
- Haneuse, S. and Rotnitzky, A. (2013), “Estimation of the effect of interventions that modify the received treatment,” Statistics in medicine, 32, 5260–5277.
- Imai, K. and Li, M. L. (2023), “Experimental evaluation of individualized treatment rules,” Journal of the American Statistical Association, 118, 242–256.
- Kallus, N. (2022), “What’s the Harm? Sharp Bounds on the Fraction Negatively Affected by Treatment,” in 36th Conference on Neural Information Processing Systems.
- Kennedy, E. H. (2022), “Semiparametric doubly robust targeted double machine learning: a review,” arXiv preprint arXiv:2203.06469.
- — (2023), “Towards optimal doubly robust estimation of heterogeneous causal effects,” Electronic Journal of Statistics, 17, 3008–3049.
- Kennedy, E. H., Balakrishnan, S., and G’Sell, M. (2020), “Sharp instruments for classifying compliers and generalizing causal effects,” The Annals of Statistics, 48, 2008–2030.
- LeDell, E., Petersen, M., and van der Laan, M. (2015), “Computationally efficient confidence intervals for cross-validated area under the ROC curve estimates,” Electronic journal of statistics, 9, 1583.
- Levis, A. W., Bonvini, M., Zeng, Z., Keele, L., and Kennedy, E. H. (2023), “Covariate-assisted bounds on causal effects with instrumental variables,” arXiv preprint arXiv:2301.12106.
- Luedtke, A. R. and van der Laan, M. J. (2016a), “Optimal individualized treatments in resource-limited settings,” The International Journal of Biostatistics, 12, 283–303.
- — (2016b), “Statistical inference for the mean outcome under a possibly non-unique optimal treatment strategy,” Annals of Statistics, 44, 713.
- Murphy, S. A. (2003), “Optimal dynamic treatment regimes,” Journal of the Royal Statistical Society: Series B (Statistical Methodology), 65, 331–355.
- Qian, M. and Murphy, S. A. (2011), “Performance guarantees for individualized treatment rules,” Annals of statistics, 39, 1180.
- Qiu, H., Carone, M., and Luedtke, A. (2022), “Individualized treatment rules under stochastic treatment cost constraints,” Journal of Causal Inference, 10, 480–493.
- Qiu, H., Carone, M., Sadikova, E., Petukhova, M., Kessler, R. C., and Luedtke, A. (2021), “Optimal individualized decision rules using instrumental variable methods,” Journal of the American Statistical Association, 116, 174–191.
- Radcliffe, N. (2007), “Using control groups to target on predicted lift: Building and assessing uplift model,” Direct Marketing Analytics Journal, 14–21.
- Rambachan, A., Coston, A., and Kennedy, E. (2022), “Counterfactual risk assessments under unmeasured confounding,” arXiv preprint arXiv:2212.09844.
- Robins, J., Li, L., Tchetgen, E., van der Vaart, A., et al. (2008), “Higher order influence functions and minimax estimation of nonlinear functionals,” in Probability and statistics: essays in honor of David A. Freedman, Institute of Mathematical Statistics, vol. 2, pp. 335–422.
- Robins, J. M. (2004), “Optimal structural nested models for optimal sequential decisions,” in Proceedings of the Second Seattle Symposium in Biostatistics: analysis of correlated data, Springer, pp. 189–326.
- Stensrud, M. J., Laurendeau, J., and Sarvet, A. L. (2022), “Optimal regimes for algorithm-assisted human decision-making,” arXiv preprint arXiv:2203.03020.
- Sun, H., Munro, E., Kalashnov, G., Du, S., and Wager, S. (2021), “Treatment allocation under uncertain costs,” arXiv preprint arXiv:2103.11066.
- Takatsu, K., Levis, A. W., Kennedy, E., Kelz, R., and Keele, L. (2023), “Doubly robust machine learning for an instrumental variable study of surgical care for cholecystitis,” arXiv preprint arXiv:2307.06269.
- Tsybakov, A. B. (2004), “Optimal aggregation of classifiers in statistical learning,” The Annals of Statistics, 32, 135–166.
- Willis, R. J. and Rosen, S. (1979), “Education and self-selection,” Journal of political Economy, 87, S7–S36.
- Young, J. G., Hernán, M. A., and Robins, J. M. (2014), “Identification, estimation and approximation of risk under interventions that depend on the natural value of treatment using observational data,” Epidemiologic Methods, 3, 1–19.
- Zeng, Z., Kennedy, E. H., Bodnar, L. M., and Naimi, A. I. (2023), “Efficient generalization and transportation,” arXiv preprint arXiv:2302.00092.
- Zhao, Y., Zeng, D., Rush, A. J., and Kosorok, M. R. (2012), “Estimating individualized treatment rules using outcome weighted learning,” Journal of the American Statistical Association, 107, 1106–1118.
- Zheng, W. and van der Laan, M. J. (2010), “Asymptotic theory for cross-validated targeted maximum likelihood estimation,” U.C. Berkeley Division of Biostatistics Working Paper Series.
- Zhou, X. and Xie, Y. (2020), “Heterogeneous treatment effects in the presence of self-selection: a propensity score perspective,” Sociological Methodology, 50, 350–385.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.