Outline

Ingegneria Sismica

Ingegneria Sismica

Application of multimodal deep learning in action pattern recognition and sports injury prediction of football players

Author(s): Zhigang Li1
1Jilin Sport University, No2476, Ziyou Road, A Changchun City
Li, Zhigang. “Application of multimodal deep learning in action pattern recognition and sports injury prediction of football players.” Ingegneria Sismica Volume 43 Issue 2: 1-22, doi:10.65102/is20261001.

Abstract

Aiming at the problems of action recognition relying on a single video feature, injury risk prediction lag and insufficient explanation of training load in soccer training, an action pattern recognition and sports injury prediction model based on multi-modal deep learning was constructed. The system fuses video skeleton key points, IMU-GPS motion sequences, heart rate, RPE, training load and previous injury records to form a dataset of 126 football players, 18420 action clips and 1260 weekly risk samples. The model extracts joint coordination features by spatio-temporal graph convolution, analyzes the changes of exercise load by sequence network, and introduces an attention mechanism to complete multimodal fusion. The experimental results show that the accuracy of action recognition of the full model is 94.6%, Macro-F1 is 93.8%, the AUC of damage prediction is 0.921, and the recall rate of high-risk damage is 88.7%. Compared with the model that removes key modes, the proposed method is more stable in scenes such as complex confrontation, emergency stop and landing buffer, and can provide data support for football training monitoring, action correction and injury warning.

Keywords
multimodal deep learning; Football player; Action pattern recognition; Sports injury prediction

Related Articles

Qianwen Xiong1, Yuhong Chen1
1Guangzhou University of Chinese Medicine, School of Pharmaceutical Medicine, Guangzhou,Guangdong,China,510006
Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China