Outline

Ingegneria Sismica

Ingegneria Sismica

Dynamic posture evaluation system for athletes based on computer vision and sensor fusion

Author(s): Yue Wang1, Meiwei Zhou2, Shujin Liu3
1Emilio Aguinaldo College, 1123, Philippines
2Harbin Sport University,Harbin 150006, Heilongjiang , China
3Guangxi College for Preschool Education, Nanning, 530022,Guangxi ,China
Wang, Yue., Zhou, Meiwei., and Liu, Shujin. “Dynamic posture evaluation system for athletes based on computer vision and sensor fusion.” Ingegneria Sismica Volume 43 Issue 2: 1-25, doi:10.65102/is2026966.

Abstract

With the development of computer vision and multi-modal perception, the dynamic posture assessment of athletes has become the research content in the field of intelligent sports analysis. In order to build a posture assessment system, this paper designs a deep vision detection module to locate athletes and extract skeleton key points in competition videos. Then, the inertial measurement, plantar pressure and joint Angle signals were synchronized by the time alignment strategy, and fused by the gated attention fusion network. The system is trained with 38640 synchronized samples from 86 athletes in sprint, basketball, football and combat training. Experimental results show that the visual branch of FusionNet is stable in complex scenes, the AP of clear scenes is 97.2%, and the AP of crowded scenes is 86.4%. Compared with the single-modal recognition method, the fusion model achieves a better classification effect, with a recall rate of 94.87%, a precision rate of 95.31%, and a F1 value of 95.09%. The overall posture evaluation accuracy reaches 96.18%, and the average inference delay remains at 31.6 ms, which supports real-time athlete evaluation in the deployment phase.

Keywords
Computer vision; Sensor fusion; Dynamic pose estimation; Multimodal time series modeling

Related Articles

Huiqiao Liu1
1Yinchuan University of Energy, Ningxia, 750000, China
Xin Zhao1, Yan Li1, Xiangyang Cao1, Qiushuang Li1, Jianing Zhang1
1State Grid Shandong Electric Power Company Economic and Technological Research Institute ShanDong JiNan 250001, China
Dan Yang1
1School of Marxism, Suzhou Polytechnic University, Suzhou, 215104, China
Liuhang Shen1, Xiangwen Sun1
1Ulster college at Shaanxi University of Science &Technology, Xi’an,710021, Shaanxi, China