Outline

Ingegneria Sismica

Ingegneria Sismica

Dynamic posture evaluation system for athletes based on computer vision and sensor fusion

Author(s): Yue Wang1, Meiwei Zhou2, Shujin Liu3
1Emilio Aguinaldo College, 1123, Philippines
2Harbin Sport University,Harbin 150006, Heilongjiang , China
3Guangxi College for Preschool Education, Nanning, 530022,Guangxi ,China
Wang, Yue., Zhou, Meiwei., and Liu, Shujin. “Dynamic posture evaluation system for athletes based on computer vision and sensor fusion.” Ingegneria Sismica Volume 43 Issue 2: 1-25, doi:10.65102/is2026966.

Abstract

With the development of computer vision and multi-modal perception, the dynamic posture assessment of athletes has become the research content in the field of intelligent sports analysis. In order to build a posture assessment system, this paper designs a deep vision detection module to locate athletes and extract skeleton key points in competition videos. Then, the inertial measurement, plantar pressure and joint Angle signals were synchronized by the time alignment strategy, and fused by the gated attention fusion network. The system is trained with 38640 synchronized samples from 86 athletes in sprint, basketball, football and combat training. Experimental results show that the visual branch of FusionNet is stable in complex scenes, the AP of clear scenes is 97.2%, and the AP of crowded scenes is 86.4%. Compared with the single-modal recognition method, the fusion model achieves a better classification effect, with a recall rate of 94.87%, a precision rate of 95.31%, and a F1 value of 95.09%. The overall posture evaluation accuracy reaches 96.18%, and the average inference delay remains at 31.6 ms, which supports real-time athlete evaluation in the deployment phase.

Keywords
Computer vision; Sensor fusion; Dynamic pose estimation; Multimodal time series modeling

Related Articles

Qianwen Xiong1, Yuhong Chen1
1Guangzhou University of Chinese Medicine, School of Pharmaceutical Medicine, Guangzhou,Guangdong,China,510006
Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China