Outline

Ingegneria Sismica

Ingegneria Sismica

A Real-Time Control Framework Combining Edge Computing and Deep Reinforcement Learning in Industry 4.0 Environments

Author(s): Qianwen Wang1
1JSNU SPBPU Institute of Engineering—Sino-Russian Institute, Jiangsu Normal University, Xuzhou, Jiangsu, 221000, China
Wang, Qianwen . “A Real-Time Control Framework Combining Edge Computing and Deep Reinforcement Learning in Industry 4.0 Environments.” Ingegneria Sismica Volume 43 Issue 3: 1-14, doi:10.65102/is20261147.

Abstract

Industry 4.0 environments are characterized by an explosion in the number of mobile devices, generating massive data and computation demands. Edge computing allows IoT devices to offload tasks to the edge environment for execution in order to fulfill the task’s demand for resources. To achieve real-time control of the edge computing environment, this study proposes a deep reinforcement learning-based task offloading and resource allocation method. The method uses the Lagrange multiplier method to solve for the optimal allocation of resources and the DDPG algorithm to search for the optimal offloading decision method. Experiments show that the method in this paper outperforms the baseline algorithm in terms of cumulative rewards and task discarding rate, meanwhile, it can significantly improve the throughput of the system while reducing the latency and energy consumption, with the former improved by 9.98%~28.61% and the latter two reduced by 8.05%~22.48% and 4.45%~16.05%, which can effectively improve the efficiency of task offloading and resource allocation in edge environments,. It has high real-time performance and good dynamic environment adaptability.

 

Keywords
edge computing; deep reinforcement learning; Lagrange multiplier method; DDPG algorithm; task offloading; resource allocation

Related Articles

Liqin Zheng1, Dongrui Qing2, Yan Zhang1
1School of Mathematics and Statistics, Shaan Xi Xue Qian Normal University Xi’an 710100, P.R.China
2School of Marxism, Xi’an University of Finance and Economics Xi’an 710100, P.R.China
Yanan Gao1, Aiqun Peng2, Nina Ma2
1Management School of Anhui Business and Technology College Hefei 230000, Anhui, China
2Economics and Trade School of Anhui Business and Technology College Hefei 230000, Anhui, China
Ya’ning Liu1, Ping Ma1
1School of Teacher Education, Shihezi University, Shihezi, Xinjiang, 832000, China
Yuhui Li1, Zhongliang Gong1
1College of Mechanical and Intelligent Manufacturing, Central South University of Forestry and Technology, Changsha, Hunan, 410004, China
Hanqing Hu1, Chengjin Liu1, Tianmu Tian1
1School of Management Science and Engineering, Beijing Information Science & Technology University, Beijing 100192