Papers
Topics
Authors
Recent
Search
2000 character limit reached

A Categorical Treatment of Open Linear Systems

Published 6 Mar 2024 in cs.LO, math.CT, and math.PR | (2403.03934v3)

Abstract: An open stochastic system `a la Jan Willems is a system affected by two qualitatively different kinds of uncertainty: one is probabilistic fluctuation, and the other one is nondeterminism caused by a fundamental lack of information. We present a formalization of open stochastic systems in the language of category theory. Central to this is the notion of copartiality which models how the lack of information propagates through a system (corresponding to the coarseness of sigma-algebras in Willems' work). As a concrete example, we study extended Gaussian distributions, which combine Gaussian probability with nondeterminism and correspond precisely to Willems' notion of Gaussian linear systems. We describe them both as measure-theoretic and abstract categorical entities, which enables us to rigorously describe a variety of phenomena like noisy physical laws and uninformative priors in Bayesian statistics. The category of extended Gaussian maps can be seen as a mutual generalization of Gaussian probability and linear relations, which connects the literature on categorical probability with ideas from control theory like signal-flow diagrams.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (39)
  1. Categorical quantum mechanics. Handbook of quantum logic and quantum structures, 2:261–325, 2009.
  2. Props in network theory, 2018. arXiv:1707.08321.
  3. Categories in control. Theory Appl. Categ., 30:836–881, 2015. arXiv:1405.6881.
  4. Graphical affine algebra. In 2019 34th Annual ACM/IEEE Symposium on Logic in Computer Science (LICS), pages 1–12. IEEE, 2019.
  5. A categorical semantics of signal flow graphs. In CONCUR 2014–Concurrency Theory: 25th International Conference, CONCUR 2014, Rome, Italy, September 2-5, 2014. Proceedings 25, pages 435–450. Springer, 2014.
  6. Interacting Hopf algebras. Journal of Pure and Applied Algebra, 221(1):144–184, 2017.
  7. Restriction categories i: categories of partial maps. Theoretical computer science, 270(1-2):223–259, 2002.
  8. Categorical probability spaces, ergodic decompositions, and transitions to equilibrium, 2024. arXiv:2310.04267.
  9. Dilations and information flow axioms in categorical probability. Mathematical Structures in Computer Science, 33(10):913–957, 2023.
  10. De Finetti’s theorem in categorical probability, 2021. arXiv:2105.02639.
  11. Representable Markov categories and comparison of statistical experiments in categorical probability, 2020. URL: https://arxiv.org/abs/2010.07416.
  12. Brenan Fong. Causal Theories: A Categorical Perspective on Bayesian Networks (MSc thesis). PhD thesis, University of Oxford, 2012.
  13. Brendan Fong. Decorated cospans. arXiv preprint arXiv:1502.00872, 2015.
  14. Brendan Fong. Decorated corelations, 2017. arXiv:1703.09888.
  15. Infinite products and zero-one laws in categorical probability. Compositionality, 2, August 2020. doi:10.32408/compositionality-2-3.
  16. T. Fritz. A synthetic approach to Markov kernels, conditional independence and theorems on sufficient statistics. Adv. Math., 370, 2020.
  17. Hypergraph categories. ArXiv, abs/1806.08304, 2019.
  18. An invitation to applied category theory: seven sketches in compositionality. Cambridge University Press, 2019.
  19. A categorical approach to open and interconnected dynamical systems. In Proceedings of the 31st annual ACM/IEEE symposium on Logic in Computer Science, pages 495–504, 2016.
  20. Bayesian Data Analysis. Chapman and Hall/CRC, 2nd ed. edition, 2004.
  21. Jakob Nebeling Hedegaard. Gaussian random fields – infinite, improper and intrinsic. Master’s thesis, Aalborg University, 2019.
  22. Jules Jacobs. Paradoxes of probabilistic programming. In Proc. POPL 2021, 2021.
  23. A.T. JAMES. The variance information manifold and the functions on it. In Multivariate Analysis–III, pages 157–169. Academic Press, 1973. URL: https://www.sciencedirect.com/science/article/pii/B9780124266537500168, doi:https://doi.org/10.1016/B978-0-12-426653-7.50016-8.
  24. Olav Kallenberg. Foundations of Modern Probability. Springer, New York, 1997.
  25. Evidential decision theory via partial markov categories, 2023. arXiv:2301.12989.
  26. Probability monads with submonads of deterministic states. In Proceedings of the 37th Annual ACM/IEEE Symposium on Logic in Computer Science, pages 1–13, 2022.
  27. A category-theoretic proof of the ergodic decomposition theorem. Ergodic Theory and Dynamical Systems, page 1–27, 2023. doi:10.1017/etds.2023.6.
  28. High-level axioms for graphical linear algebra. Science of Computer Programming, 218:102791, 2022. URL: https://www.sciencedirect.com/science/article/pii/S0167642322000247, doi:https://doi.org/10.1016/j.scico.2022.102791.
  29. Richard Samuelson. GaussianRelations.jl. https://github.com/samuelsonric/GaussianRelations.jl, 2024.
  30. P. Selinger. A Survey of Graphical Languages for Monoidal Categories, pages 289–355. Springer Berlin Heidelberg, Berlin, Heidelberg, 2011. doi:10.1007/978-3-642-12821-9_4.
  31. Exact Bayesian inference by symbolic disintegration. In Proc. POPL 2017, 2017.
  32. Compositional semantics for probabilistic programs with exact conditioning (long version), 2021. URL: https://arxiv.org/abs/2101.11351, arXiv:2101.11351.
  33. A category for unifying gaussian probability and nondeterminism. In 10th Conference on Algebra and Coalgebra in Computer Science (CALCO 2023). Schloss Dagstuhl-Leibniz-Zentrum für Informatik, 2023.
  34. Towards a compositional framework for convex analysis (with applications to probability theory). arXiv preprint arXiv:2312.02291, 2023.
  35. Dario Stein. GaussianInfer. https://github.com/damast93/GaussianInfer, 2021.
  36. Graphical quadratic algebra, 2024. arXiv:2403.02284.
  37. Jan C Willems. The behavioral approach to open and interconnected systems. IEEE control systems magazine, 27(6):46–99, 2007.
  38. Jan C. Willems. Open stochastic systems. IEEE Transactions on Automatic Control, 58(2):406–421, 2013. doi:10.1109/TAC.2012.2210836.
  39. No-go theorems for distributive laws. In Proceedings of the 34th Annual ACM/IEEE Symposium on Logic in Computer Science, LICS ’19. IEEE Press, 2019.
Citations (1)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Authors (2)

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 2 tweets with 0 likes about this paper.