Deep Diffusion Deterministic Policy Gradient based Performance Optimization for Wi-Fi Networks
Abstract: Generative Diffusion Models (GDMs), have made significant strides in modeling complex data distributions across diverse domains. Meanwhile, Deep Reinforcement Learning (DRL) has demonstrated substantial improvements in optimizing Wi-Fi network performance. Wi-Fi optimization problems are highly challenging to model mathematically, and DRL methods can bypass complex mathematical modeling, while GDMs excel in handling complex data modeling. Therefore, combining DRL with GDMs can mutually enhance their capabilities. The current MAC layer access mechanism in Wi-Fi networks is the Distributed Coordination Function (DCF), which dramatically decreases in performance with a high number of terminals. In this study, we propose the Deep Diffusion Deterministic Policy Gradient (D3PG) algorithm, which integrates diffusion models with the Deep Deterministic Policy Gradient (DDPG) framework to optimize Wi-Fi network performance. To the best of our knowledge, this is the first work to apply such an integration in Wi-Fi performance optimization. We propose an access mechanism that jointly adjusts the contention window and the aggregation frame length based on the D3PG algorithm. Through simulations, we have demonstrated that this mechanism significantly outperforms existing Wi-Fi standards in dense Wi-Fi scenarios, maintaining performance even as the number of users increases sharply.
- F.-A. Croitoru, V. Hondru, R. T. Ionescu, and M. Shah, “Diffusion models in vision: A survey,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023.
- B. Trabucco, K. Doherty, M. Gurinas, and R. Salakhutdinov, “Effective data augmentation with diffusion models,” arXiv preprint arXiv:2302.07944, 2023.
- H. Du, R. Zhang, Y. Liu, J. Wang, Y. Lin, Z. Li, D. Niyato, J. Kang, Z. Xiong, S. Cui et al., “Beyond deep reinforcement learning: A tutorial on generative diffusion models in network optimization,” arXiv preprint arXiv:2308.05384, 2023.
- H. Du, Z. Li, D. Niyato, J. Kang, Z. Xiong, H. Huang, and S. Mao, “Diffusion-based reinforcement learning for edge-enabled ai-generated content services,” IEEE Transactions on Mobile Computing, 2024.
- G. Bianchi, “Performance analysis of the ieee 802.11 distributed coordination function,” IEEE Journal on selected areas in communications, vol. 18, no. 3, pp. 535–547, 2000.
- D. Camps-Mur, M. D. Gomony, X. Pérez-Costa, and S. Sallent-Ribes, “Leveraging 802.11 n frame aggregation to enhance qos and power consumption in wi-fi networks,” Computer Networks, vol. 56, no. 12, pp. 2896–2911, 2012.
- E. Coronado, A. Thomas, and R. Riggio, “Adaptive ml-based frame length optimisation in enterprise sd-wlans,” Journal of Network and Systems Management, vol. 28, no. 4, pp. 850–881, 2020.
- The ns-3 Network Simulator Project, “ns-3 — a discrete-event network simulator for internet systems,” https://www.nsnam.org, 2024, [Online; accessed 3-April-2024].
- H. Yin, P. Liu, K. Liu, L. Cao, L. Zhang, Y. Gao, and X. Hei, “Ns3-ai: Fostering artificial intelligence algorithms for networking research,” in Proceedings of the 2020 Workshop on Ns-3, ser. WNS3 2020. New York, NY, USA: Association for Computing Machinery, 2020, p. 57–64. [Online]. Available: https://doi.org/10.1145/3389400.3389404
- J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Proximal policy optimization algorithms,” arXiv preprint arXiv:1707.06347, 2017.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.