Outline

Ingegneria Sismica

Ingegneria Sismica

Design of a Deep Learning-based System for Recognizing and Evaluating Traditional Martial Arts Movements

Author(s): Xu Wang1, Xiaoyun Fan2, Biao Ma1, Jingtang He1
1College of Physical Education, Huainan Normal University, Huainan, Anhui, 232038, China
2Art and Sports Department, North Anhui Electronic Information Engineering School, Fuyang, Anhui, 236600, China
Wang, Xu. et al “Design of a Deep Learning-based System for Recognizing and Evaluating Traditional Martial Arts Movements.” Ingegneria Sismica Volume 43 Issue 2: 1-19, doi:10.65102/is2026668.

Abstract

Action recognition and evaluation of traditional martial arts routines has always been difficult, and an intelligent solution based on deep learning is proposed to address this problem. This solution combines the convolutional neural network as well as the long and short-term memory network algorithms, the convolutional neural network is used to extract the spatial features of each video frame, and the long and short-term memory network is used to mine the characteristics of the action sequences of the wushu routines. Meanwhile, the fusion of different scale features is carried out in the feature layer, and the public pose estimation algorithm is used to predict the position of human joints as auxiliary information, and the position of joints and the image features are weighted and fused by attention to get the final image features. Finally, the end-to-end approach is used for model training, combined with the multi-objective classification regression method to improve the classification performance and prediction effect. The test shows that the recognition accuracy of the five types of traditional martial arts movements reaches 94.2%, and the correlation between the system prediction value and the score given by the boxer is r=0.89, which indicates that this system has certain practical application value and feasibility.

Keywords
deep learning; traditional wushu; action recognition; evaluation system; multimodal fusion

Related Articles

Yutong Wu1, Qiang Cai2, Lingxia Wu3
1Si Chuan Open University, Si Chuan, China
2Si Chuan Normal University, Si Chuan, China
3Mian Yang Open University, Si Chuan, China
Juan Tan1
1School of Languages and Media, Anhui University of Finance and Economics, Bengbu 233030, Anhui, China
Fan Xu1, Jiannan Zhang2
1Xi’an Siyuan University, Xi’an 710038, Shaanxi, China
2Shaanxi Yonghua Ceramic Art Culture Co., Ltd., Xi’an 710000, Shaanxi, China
Shujing Zhang1
1School of Accounting of HeNan University of Engineering ZhengZhou 451191, HanNan, China