Outline

Ingegneria Sismica

Ingegneria Sismica

Design of a Deep Learning-based System for Recognizing and Evaluating Traditional Martial Arts Movements

Author(s): Xu Wang1, Xiaoyun Fan2, Biao Ma1, Jingtang He1
1College of Physical Education, Huainan Normal University, Huainan, Anhui, 232038, China
2Art and Sports Department, North Anhui Electronic Information Engineering School, Fuyang, Anhui, 236600, China
Wang, Xu. et al “Design of a Deep Learning-based System for Recognizing and Evaluating Traditional Martial Arts Movements.” Ingegneria Sismica Volume 43 Issue 2: 1-19, doi:10.65102/is2026668.

Abstract

Action recognition and evaluation of traditional martial arts routines has always been difficult, and an intelligent solution based on deep learning is proposed to address this problem. This solution combines the convolutional neural network as well as the long and short-term memory network algorithms, the convolutional neural network is used to extract the spatial features of each video frame, and the long and short-term memory network is used to mine the characteristics of the action sequences of the wushu routines. Meanwhile, the fusion of different scale features is carried out in the feature layer, and the public pose estimation algorithm is used to predict the position of human joints as auxiliary information, and the position of joints and the image features are weighted and fused by attention to get the final image features. Finally, the end-to-end approach is used for model training, combined with the multi-objective classification regression method to improve the classification performance and prediction effect. The test shows that the recognition accuracy of the five types of traditional martial arts movements reaches 94.2%, and the correlation between the system prediction value and the score given by the boxer is r=0.89, which indicates that this system has certain practical application value and feasibility.

Keywords
deep learning; traditional wushu; action recognition; evaluation system; multimodal fusion

Related Articles

Huiqiao Liu1
1Yinchuan University of Energy, Ningxia, 750000, China
Xin Zhao1, Yan Li1, Xiangyang Cao1, Qiushuang Li1, Jianing Zhang1
1State Grid Shandong Electric Power Company Economic and Technological Research Institute ShanDong JiNan 250001, China
Dan Yang1
1School of Marxism, Suzhou Polytechnic University, Suzhou, 215104, China
Liuhang Shen1, Xiangwen Sun1
1Ulster college at Shaanxi University of Science &Technology, Xi’an,710021, Shaanxi, China