Outline

Ingegneria Sismica

Ingegneria Sismica

Deep learning detection model for industrial robot grasping target based on multi-scale attention mechanism fusion

Author(s): Junli Hu1
1School of Mechanical and Electrical Engineering, Henan Industry and Trade Vocational College, Zhengzhou 451191, Henan Province, China
Hu, Junli. “Deep learning detection model for industrial robot grasping target based on multi-scale attention mechanism fusion.” Ingegneria Sismica Volume 43 Issue 1: 1-21, doi:10.65102/is2026325.

Abstract

In cluttered manufacturing cells, industrial robot grasping needs to deal with occlusion, reflection, scale change and attitude deflection at the same time, and it is difficult to stably complete target recognition and grasp parameter expression with single-layer features. This paper proposes a deep learning detection model that combines multi-scale attention mechanism and hierarchical feature interaction, and constructs an integrated framework of scene modeling, feature enhancement, localization regression and task mapping. The model jointly uses shallow texture and high-level semantic information, and the detection head synchronously outputs the category, center coordinates, width and height parameters and rotation direction. Experiments are carried out on 18240 RGB-D images. The results show that the mAP@0.5 of the proposed method in four types of industrial scenarios is higher than 95.84%, the test set Accuracy reaches 96.74%, and the total system delay is 24.6ms under TensorRT acceleration. Compared with YOLOv5s, HTC-Grasp, FAGD-Net and ODGNet, the proposed model has lower missed detection rate and more stable online calling ability, which can provide reliable visual support for industrial robots to grasp in real-time.

Keywords
Multi-scale attention mechanism; Industrial robot; Grasp object detection; Deep learning

Related Articles

Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China
Ken Wang1, Jinhan Shu2, Kan Yuan1
1School of Digital Media, Shenzhen Polytechnic University, Shenzhen 518055, Guangdong, China
2Postdoctoral Mobile Station of Journalism and communication, Fudan University, Shanghai 200433, Shanghai, China