Outline

Ingegneria Sismica

Ingegneria Sismica

Real-Time Path Planning for Unmanned Vehicles in Dynamic Environments via Improved Deep Reinforcement Learning

Author(s): Zhen Long1, Shihao Lei1
1School of Electrical and Information Engineering, Jiangsu University, Zhenjiang, 212013, Jiangsu, China
Long, Zhen . and Lei, Shihao . “Real-Time Path Planning for Unmanned Vehicles in Dynamic Environments via Improved Deep Reinforcement Learning.” Ingegneria Sismica Volume 43 Issue 2: 1-17, doi:10.65102/is2026812.

Abstract

Aiming at the problems faced by unmanned vehicles in dynamic environment, such as the uncertainty of obstacle movement, the limited time delay of online re planning, and the difficulty of taking into account the safety and smoothness of trajectory, this paper proposes a real-time path planning method based on improved deep reinforcement learning. Based on the local dynamic occupation representation, the method integrates risk information such as relative distance, relative speed, collision time and obstacle density, and introduces attention weighting to enhance the perception of key targets; At the decision-making level, improved SAC and priority experience playback are used to improve the stability of continuous motion learning; In the execution layer, the safety action correction and MPC smooth optimization are combined to improve the trajectory executability. Four kinds of dynamic scenes were constructed based on carla-ros joint environment, and compared with A*, DWA, PPO and original SAC. The results show that the proposed method has better comprehensive performance in terms of success rate, collision rate, path length, minimum safe distance and online planning delay, while maintaining good robustness and generalization ability in the absence of speed, higher obstacle density and noisy conditions.

Keywords
Deep reinforcement learning; autonomous vehicle; dynamic environment; real-time path planning; safety constraint

Related Articles

Qianwen Xiong1, Yuhong Chen1
1Guangzhou University of Chinese Medicine, School of Pharmaceutical Medicine, Guangzhou,Guangdong,China,510006
Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China