Computation Offloading for Multi-server Multi-access Edge Vehicular Networks: A DDQN-based Method
Abstract: In this paper, we investigate a multi-user offloading problem in the overlapping domain of a multi-server mobile edge computing system. We divide the original problem into two stages: the offloading decision making stage and the request scheduling stage. To prevent the terminal from going out of service area during offloading, we consider the mobility parameter of the terminal according to the human behaviour model when making the offloading decision, and then introduce a server evaluation mechanism based on both the mobility parameter and the server load to select the optimal offloading server. In order to fully utilise the server resources, we design a double deep Q-network (DDQN)-based reward evaluation algorithm that considers the priority of tasks when scheduling offload requests. Finally, numerical simulations are conducted to verify that our proposed method outperforms traditional mathematical computation methods as well as the DQN algorithm.
- P. Mach and Z. Becvar, “Mobile Edge Computing: A Survey on Architecture and Computation Offloading.” IEEE Commun. Surv. Tutorials., vol. 19, no. 3, pp. 1628-1656, thirdquarter 2017.
- B. Yang, X. Cao, J. Bassey, X. Li and L. Qian, “Computation Offloading in Multi-Access Edge Computing: A Multi-Task Learning Approach.” IEEE Trans. Mob. Comput., vol. 20, no. 9, pp. 2745-2762, Sept. 2021.
- L. Gao and M. Moh, “Joint Computation Offloading and Prioritized Scheduling in Mobile Edge Computing.” in Proc. Int. Conf. High Perform. Comput. Simul. (HPCS), Orleans, France, 2018.
- C. Wu, Z. Huang and Y. Zou, “Delay Constrained Hybrid Task Offloading of Internet of Vehicle: A Deep Reinforcement Learning Method.” IEEE Access, vol. 10, pp. 102778-102788, 2022.
- M. S. Bute, P. Fan, G. Liu, F. Abbas and Z. Ding, “A Collaborative Task Offloading Scheme in Vehicular Edge Computing.” in proc. 2021 IEEE 93rd Veh. Technol. Conf. (VTC2021-Spring), Helsinki, Finland, 2021.
- Y. Jang, J. Na, S. Jeong and J. Kang, “Energy-Efficient Task Offloading for Vehicular Edge Computing: Joint Optimization of Offloading and Bit Allocation.” in proc. 2020 IEEE 91st Veh. Technol. Conf. (VTC2020-Spring), Antwerp, Belgium, 2020.
- V. Huy Hoang, T. M. Ho and L. B. Le, “Mobility-Aware Computation Offloading in MEC-Based Vehicular Wireless Networks.” IEEE Commun. Lett., vol. 24, no. 2, pp. 466-469, Feb. 2020.
- F. Jiang, W. Liu, J. Wang and X. Liu, “Q-Learning Based Task Offloading and Resource Allocation Scheme for Internet of Vehicles.” in proc. IEEE/CIC ICCC, Chongqing, China, 2020.
- M. Tang and V. W. S. Wong, “Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing Systems.” IEEE Trans. Mob. Comput., vol. 21, no. 6, pp. 1985-1997, 1 June 2022.
- J. Gao, Z. Kuang, J. Gao and L. Zhao, “Joint Offloading Scheduling and Resource Allocation in Vehicular Edge Computing: A Two Layer Solution.” IEEE Trans. Veh. Technol., vol. 72, no. 3, pp. 3999-4009, March 2023.
- Van Hasselt, Hado, Arthur Guez, and David Silver. “Deep reinforcement learning with double q-learning.” in proc. AAAI Conf. Artif. Intell., Phoenix, Arizona USA, 2016.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.