Outline

Ingegneria Sismica

Ingegneria Sismica

A Real-Time Control Framework Combining Edge Computing and Deep Reinforcement Learning in Industry 4.0 Environments

Author(s): Qianwen Wang1
1JSNU SPBPU Institute of Engineering—Sino-Russian Institute, Jiangsu Normal University, Xuzhou, Jiangsu, 221000, China
Wang, Qianwen . “A Real-Time Control Framework Combining Edge Computing and Deep Reinforcement Learning in Industry 4.0 Environments.” Ingegneria Sismica Volume 43 Issue 3: 1-14, doi:10.65102/is20261147.

Abstract

Industry 4.0 environments are characterized by an explosion in the number of mobile devices, generating massive data and computation demands. Edge computing allows IoT devices to offload tasks to the edge environment for execution in order to fulfill the task’s demand for resources. To achieve real-time control of the edge computing environment, this study proposes a deep reinforcement learning-based task offloading and resource allocation method. The method uses the Lagrange multiplier method to solve for the optimal allocation of resources and the DDPG algorithm to search for the optimal offloading decision method. Experiments show that the method in this paper outperforms the baseline algorithm in terms of cumulative rewards and task discarding rate, meanwhile, it can significantly improve the throughput of the system while reducing the latency and energy consumption, with the former improved by 9.98%~28.61% and the latter two reduced by 8.05%~22.48% and 4.45%~16.05%, which can effectively improve the efficiency of task offloading and resource allocation in edge environments,. It has high real-time performance and good dynamic environment adaptability.

 

Keywords
edge computing; deep reinforcement learning; Lagrange multiplier method; DDPG algorithm; task offloading; resource allocation

Related Articles

Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China
Ken Wang1, Jinhan Shu2, Kan Yuan1
1School of Digital Media, Shenzhen Polytechnic University, Shenzhen 518055, Guangdong, China
2Postdoctoral Mobile Station of Journalism and communication, Fudan University, Shanghai 200433, Shanghai, China