Outline

Ingegneria Sismica

Ingegneria Sismica

Design of a Deep Learning-based System for Recognizing and Evaluating Traditional Martial Arts Movements

Author(s): Xu Wang1, Xiaoyun Fan2, Biao Ma1, Jingtang He1
1College of Physical Education, Huainan Normal University, Huainan, Anhui, 232038, China
2Art and Sports Department, North Anhui Electronic Information Engineering School, Fuyang, Anhui, 236600, China
Wang, Xu. et al “Design of a Deep Learning-based System for Recognizing and Evaluating Traditional Martial Arts Movements.” Ingegneria Sismica Volume 43 Issue 2: 1-19, doi:10.65102/is2026668.

Abstract

Action recognition and evaluation of traditional martial arts routines has always been difficult, and an intelligent solution based on deep learning is proposed to address this problem. This solution combines the convolutional neural network as well as the long and short-term memory network algorithms, the convolutional neural network is used to extract the spatial features of each video frame, and the long and short-term memory network is used to mine the characteristics of the action sequences of the wushu routines. Meanwhile, the fusion of different scale features is carried out in the feature layer, and the public pose estimation algorithm is used to predict the position of human joints as auxiliary information, and the position of joints and the image features are weighted and fused by attention to get the final image features. Finally, the end-to-end approach is used for model training, combined with the multi-objective classification regression method to improve the classification performance and prediction effect. The test shows that the recognition accuracy of the five types of traditional martial arts movements reaches 94.2%, and the correlation between the system prediction value and the score given by the boxer is r=0.89, which indicates that this system has certain practical application value and feasibility.

Keywords
deep learning; traditional wushu; action recognition; evaluation system; multimodal fusion

Related Articles

Chao Liu1
1Business College, Jiangsu Vocational College of Electronics and Information, Huaian, Jiangsu, 223003, China
Caihong Feng1
1Department of Development and Planning of Yulin University, Yulin, 719000, China
Wei Xu1, Yimin Shen1, Jianqin Shi1
1Jiaxing Nanyang Polytechnic Institute; Jiaxing City, Zhejiang Province, 314031