Finite-sample characterization of Distributional Active Inference (DAIF)

Establish a rigorous characterization of the finite-sample characteristics of the Distributional Active Inference (DAIF) algorithm within the distributional reinforcement learning framework.

Background

The paper introduces DAIF, a model-free algorithm that integrates active inference into distributional reinforcement learning via push-forward constructions and shows improved contraction properties compared to standard distributional RL.

While asymptotic convergence inherits known guarantees from distributional RL, the authors note that finite-sample behavior remains theoretically uncharacterized. They suggest their framework may support future analyses, potentially by extending sample complexity tools from linear-quadratic control to well-behaved nonlinear systems.

References

A rigorous characterization of its finite-sample characteristics is an open question, as it is for the distributional RL field.

Distributional Active Inference  (2601.20985 - Akgül et al., 28 Jan 2026) in Section 7: Takeaways and Open Questions