Papers
Topics
Authors
Recent
Search
2000 character limit reached

The END: Estimation Network Design for games under partial-decision information

Published 24 Aug 2022 in math.OC, cs.GT, cs.MA, and cs.NI | (2208.11377v2)

Abstract: Multi-agent decision problems are typically solved via distributed iterative algorithms, where the agents only communicate between themselves on a peer-to-peer network. Each agent usually maintains a copy of each decision variable, while agreement among the local copies is enforced via consensus protocols. Yet, each agent is often directly influenced by a small portion of the decision variables only: neglecting this sparsity results in redundancy, poor scalability with the network size, communication and memory overhead. To address these challenges, we develop Estimation Network Design (END), a framework for the design and analysis of distributed algorithms, generalizing several recent approaches. END algorithms can be tuned to exploit problem-specific sparsity structures, by optimally allocating copies of each variable only to a subset of agents, to improve efficiency and minimize redundancy. We illustrate the END's potential by designing new algorithms for generalised Nash equilibrium (GNE) seeking under partial-decision information, that can leverage the sparsity in cost functions, constraints and aggregation values. Finally, we test numerically our methods on a unicast rate allocation problem, revealing greatly reduced communication and memory costs.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (38)
  1. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, “Distributed optimization and statistical learning via the alternating direction method of multipliers,” Foundations and Trends in Machine Learning, vol. 3, 2010.
  2. F. Facchinei and C. Kanzow, “Generalized Nash equilibrium problems,” 4OR, vol. 5, pp. 461–464, 2007.
  3. H.-B. Dürr, M. S. Stanković, and K. H. Johansson, “Distributed positioning of autonomous mobile sensors with application to coverage control,” in Proceedings of the 2011 American Control Conference, 2011, pp. 4822–4827.
  4. M. Ye and G. Hu, “Distributed Nash equilibrium seeking by a consensus based approach,” IEEE Transactions on Automatic Control, vol. 62, no. 9, pp. 4811–4818, 2017.
  5. A. R. Romano and L. Pavel, “An inexact-penalty method for GNE seeking in games with dynamic agents,” IEEE Transactions on Control of Network Systems, pp. 1–12, 2023.
  6. L. Pavel, “Distributed GNE seeking under partial-decision information over networks via a doubly-augmented operator splitting approach,” IEEE Transactions on Automatic Control, vol. 65, no. 4, pp. 1584–1597, 2020.
  7. M. Bianchi, G. Belgioioso, and S. Grammatico, “Fast generalized Nash equilibrium seeking under partial-decision information,” Automatica, vol. 136, p. 110080, 2022.
  8. D. Gadjov and L. Pavel, “An algorithm for resilient Nash equilibrium seeking in the partial information setting,” IEEE Transactions on Control of Network Systems, pp. 1–10, 2023.
  9. Y. Zhu, W. Yu, W. Ren, G. Wen, and J. Gu, “Generalized Nash equilibrium seeking via continuous-time coordination dynamics over digraphs,” IEEE Transactions on Control of Network Systems, vol. 8, no. 2, pp. 1023–1033, 2021.
  10. F. Salehisadaghiani and L. Pavel, “Distributed Nash equilibrium seeking in networked graphical games,” Automatica, vol. 87, pp. 17–24, 2018.
  11. T. Alpcan and T. Basar, “A game-theoretic framework for congestion control in general topology networks,” in 41st IEEE Conference on Decision and Control (CDC), vol. 2, 2002, pp. 1218–1224.
  12. F. Salehisadaghiani and L. Pavel, “Nash equilibrium seeking with non-doubly stochastic communication weight matrix,” EAI Endorsed Transactions on Collaborative Computing, vol. 4, pp. 3–15, 2020.
  13. I. Necoara and D. Clipici, “Parallel random coordinate descent method for composite minimization: Convergence analysis and error bounds,” SIAM Journal on Optimization, vol. 26, no. 1, pp. 197–226, 2016.
  14. J. F. Mota, J. M. Xavier, P. M. Aguiar, and M. Puschel, “Distributed optimization with local domains: Applications in MPC and network flows,” IEEE Transactions on Automatic Control, vol. 60, no. 7, pp. 2004–2009, 2015.
  15. S. A. Alghunaim, K. Yuan, and A. H. Sayed, “A proximal diffusion strategy for multiagent optimization with sparse affine constraints,” IEEE Transactions on Automatic Control, vol. 65, no. 11, pp. 4554–4567, 2020.
  16. S. A. Alghunaim and A. H. Sayed, “Distributed coupled multiagent stochastic optimization,” IEEE Transactions on Automatic Control, vol. 65, no. 1, pp. 175–190, 2020.
  17. I. Notarnicola, R. Carli, and G. Notarstefano, “Distributed partitioned big-data optimization via asynchronous dual decomposition,” IEEE Transactions on Control of Network Systems, vol. 5, no. 4, pp. 1910–1919, 2018.
  18. A. Nedić, A. Olshevsky, , and W. Shi, “Achieving geometric convergence for distributed optimization over time-varying graphs,” SIAM Journal on Optimization, vol. 27, no. 4, pp. 2597–2633, 2017.
  19. D. Fullmer and A. S. Morse, “A distributed algorithm for computing a common fixed point of a finite family of paracontractions,” IEEE Transactions on Automatic Control, vol. 63, no. 9, pp. 2833–2843, 2018.
  20. F. Salehisadaghiani and L. Pavel, “Distributed Nash equilibrium seeking: A gossip-based algorithm,” Automatica, vol. 72, pp. 209–216, 2016.
  21. M. Bianchi and S. Grammatico, “Nash equilibrium seeking under partial-decision information over directed communication networks,” in 2020 59th IEEE Conference on Decision and Control (CDC), 2020, pp. 3555–3560.
  22. T. Tatarenko, W. Shi, and A. Nedic, “Geometric convergence of gradient play algorithms for distributed Nash equilibrium seeking,” IEEE Transactions on Automatic Control, vol. 66, no. 11, pp. 5342–5353, 2021.
  23. E. Eslami, H. Kebriaei, H. Atrianfar, and F. Farhadi, “Incentive mechanism design for unicast service provisioning with network aggregative game,” IEEE Transactions on Automatic Control, doi: 10.1109/TAC.2022.3144132, pp. 572–579, 2022.
  24. M. Bianchi and S. Grammatico, “The END: Estimation Network Design for efficient distributed equilibrium seeking,” 2022. [Online]. Available: https://arxiv.org/abs/2208.11377
  25. J. C. Parinya and Fakcharoenphol, “Simple distributed algorithms for approximating minimum Steiner trees,” L. Wang, Ed.   Springer Berlin Heidelberg, 2005, pp. 380–389.
  26. M. Bianchi, E. Benenati, and S. Grammatico, “Linear convergence in time-varying generalized Nash equilibrium problems,” in 62nd IEEE Conference on Decision and Control (CDC), 2023. [Online]. Available: https://arxiv.org/abs/2304.09593
  27. J. Xu, Y. Tian, Y. Sun, and G. Scutari, “Distributed algorithms for composite optimization: Unified framework and convergence analysis,” IEEE Transactions on Signal Processing, vol. 69, pp. 3555–3570, 2021.
  28. J. Koshal, A. Nedić, and U. V. Shanbhag, “Distributed algorithms for aggregative games on graphs,” Operations Research, vol. 64, pp. 680–704, 2016.
  29. B. Wang, Y. Wu, and K. R. Liu, “Game theory for cognitive radio networks: An overview,” Computer Networks, vol. 54, no. 14, pp. 2537–2561, 2010.
  30. M. Bianchi and S. Grammatico, “Fully distributed Nash equilibrium seeking over time-varying communication networks with linear convergence rate,” IEEE Control Systems Letters, vol. 5, no. 2, pp. 499–504, 2021.
  31. D. T. A. Nguyen, D. T. Nguyen, and A. Nedić, “Distributed Nash equilibrium seeking over time-varying directed communication networks,” 2023. [Online]. Available: https://arxiv.org/abs/2201.02323
  32. F. Parise, B. Gentile, and J. Lygeros, “A distributed algorithm for almost-Nash equilibria of average aggregative games with coupling constraints,” IEEE Transactions on Control of Network Systems, vol. 7, no. 2, pp. 770–782, 2020.
  33. D. Gadjov and L. Pavel, “Single-timescale distributed GNE seeking for aggregative games over networks via forward-backward operator splitting,” IEEE Transactions on Automatic Control, vol. 66, no. 7, pp. 3259–3266.
  34. X. Li, X. Yi, and L. Xie, “Distributed online convex optimization with an aggregative variable,” IEEE Transactions on Control of Network Systems, vol. 9, no. 1, pp. 438–449, 2022.
  35. A. Koloskova, S. U. Stich, and M. Jaggi, “Decentralized stochastic optimization and gossip algorithms with compressed communication,” in 36th International Conference on Machine Learning (ICML) 2019, 2019, pp. 3478–3487.
  36. M. Charikar, C. Chekuri, T. Cheung, Z. Dai, A. Goel, S. Guha, and M. Li, “Approximation algorithms for directed Steiner problems,” Journal of Algorithms, vol. 33, pp. 73–91, 1999.
  37. T. Erseghe, “A distributed and scalable processing method based upon ADMM,” IEEE Signal Processing Letters, vol. 19, no. 9, pp. 563–566, 2012.
  38. M. Todescato, N. Bof, G. Cavraro, R. Carli, and L. Schenato, “Partition-based multi-agent optimization in the presence of lossy and asynchronous communication,” Automatica, vol. 111, p. 108648, 2020.
Citations (4)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.