Covariate-adaptive ensemble weights achieving oracle efficiency

Establish whether covariate-adaptive ensemble weights for aggregating site-specific conformal-score quantile estimates across multiple data sources in the proposed multi-source conformal inference framework can produce prediction intervals that are as efficient as an oracle with knowledge of the optimal prediction interval.

Background

The paper introduces a multi-source conformal inference framework that aggregates information across potentially heterogeneous sites using federated weights learned from data. The current weighting scheme is global and not explicitly adapted to subject-level covariates.

The authors propose extending this approach to covariate-adaptive ensemble weights and conjecture that such adaptation could yield prediction intervals matching the efficiency of an oracle that knows the optimal prediction interval. Formalizing and proving (or refuting) this conjecture requires developing and analyzing covariate-dependent weighting strategies and their efficiency properties under distribution shift.

References

We conjecture that covariate-adaptive methods could produce prediction intervals that are as efficient as an oracle with knowledge of the optimal prediction interval, although we leave this for future work.

Multi-Source Conformal Inference Under Distribution Shift  (2405.09331 - Liu et al., 2024) in Section 6, Discussion