Outline

Ingegneria Sismica

Ingegneria Sismica

Real-Time Path Planning for Unmanned Vehicles in Dynamic Environments via Improved Deep Reinforcement Learning

Author(s): Zhen Long1, Shihao Lei1
1School of Electrical and Information Engineering, Jiangsu University, Zhenjiang, 212013, Jiangsu, China
Long, Zhen . and Lei, Shihao . “Real-Time Path Planning for Unmanned Vehicles in Dynamic Environments via Improved Deep Reinforcement Learning.” Ingegneria Sismica Volume 43 Issue 2: 1-17, doi:10.65102/is2026812.

Abstract

Aiming at the problems faced by unmanned vehicles in dynamic environment, such as the uncertainty of obstacle movement, the limited time delay of online re planning, and the difficulty of taking into account the safety and smoothness of trajectory, this paper proposes a real-time path planning method based on improved deep reinforcement learning. Based on the local dynamic occupation representation, the method integrates risk information such as relative distance, relative speed, collision time and obstacle density, and introduces attention weighting to enhance the perception of key targets; At the decision-making level, improved SAC and priority experience playback are used to improve the stability of continuous motion learning; In the execution layer, the safety action correction and MPC smooth optimization are combined to improve the trajectory executability. Four kinds of dynamic scenes were constructed based on carla-ros joint environment, and compared with A*, DWA, PPO and original SAC. The results show that the proposed method has better comprehensive performance in terms of success rate, collision rate, path length, minimum safe distance and online planning delay, while maintaining good robustness and generalization ability in the absence of speed, higher obstacle density and noisy conditions.

Keywords
Deep reinforcement learning; autonomous vehicle; dynamic environment; real-time path planning; safety constraint

Related Articles

Huiqiao Liu1
1Yinchuan University of Energy, Ningxia, 750000, China
Xin Zhao1, Yan Li1, Xiangyang Cao1, Qiushuang Li1, Jianing Zhang1
1State Grid Shandong Electric Power Company Economic and Technological Research Institute ShanDong JiNan 250001, China
Dan Yang1
1School of Marxism, Suzhou Polytechnic University, Suzhou, 215104, China
Liuhang Shen1, Xiangwen Sun1
1Ulster college at Shaanxi University of Science &Technology, Xi’an,710021, Shaanxi, China