Outline

Ingegneria Sismica

Ingegneria Sismica

Research on emotion Recognition and Personalized music therapy System for the Elderly Based on deep learning

Author(s): Yuan Fang1, Lin Li2
1School of Special Education, Changchun University, Changchun 130022, Jilin, China
2School of Music, Changchun University, Changchun 130022, Jilin, China
Fang, Yuan. and Li, Lin. “Research on emotion Recognition and Personalized music therapy System for the Elderly Based on deep learning.” Ingegneria Sismica Volume 43 Issue 1: 1-22, doi:10.65102/is2026257.

Abstract

Aiming at the problems of weak emotional expression range, large modal differences and lack of dynamic adaptation of music intervention in the elderly, this paper proposes a deep learning based emotion recognition and personalized music therapy system for the elderly. This method fuses speech, face, physiological and interaction information, constructs a convolutional coding, bidirectional temporal modeling and cross-modal attention coordination framework, and realizes the stable discrimination of emotional states in the elderly. On this basis, a recommendation mechanism combining user preference, historical feedback and music content characteristics is introduced to form a closed loop of “identification-recommendation-update”. The experimental results show that the Accuracy, Macro-F1 and AUC of the proposed model reach 93.84%, 92.47%and 95.12%respectively. After 4 weeks of intervention, the emotional improvement rate of the experimental group increases to 27.6%, and the average inference delay of the system is 23.6 ms. The research shows that this method has good application potential in intelligent elderly care and digital music therapy scenarios.

 

Keywords
emotion recognition in the elderly; Deep learning; Personalized music therapy; Multimodal fusion

Related Articles

Huiqiao Liu1
1Yinchuan University of Energy, Ningxia, 750000, China
Xin Zhao1, Yan Li1, Xiangyang Cao1, Qiushuang Li1, Jianing Zhang1
1State Grid Shandong Electric Power Company Economic and Technological Research Institute ShanDong JiNan 250001, China
Dan Yang1
1School of Marxism, Suzhou Polytechnic University, Suzhou, 215104, China
Liuhang Shen1, Xiangwen Sun1
1Ulster college at Shaanxi University of Science &Technology, Xi’an,710021, Shaanxi, China