Outline

Ingegneria Sismica

Ingegneria Sismica

Research on emotion Recognition and Personalized music therapy System for the Elderly Based on deep learning

Author(s): Yuan Fang1, Lin Li2
1School of Special Education, Changchun University, Changchun 130022, Jilin, China
2School of Music, Changchun University, Changchun 130022, Jilin, China
Fang, Yuan. and Li, Lin. “Research on emotion Recognition and Personalized music therapy System for the Elderly Based on deep learning.” Ingegneria Sismica Volume 43 Issue 1: 1-22, doi:10.65102/is2026257.

Abstract

Aiming at the problems of weak emotional expression range, large modal differences and lack of dynamic adaptation of music intervention in the elderly, this paper proposes a deep learning based emotion recognition and personalized music therapy system for the elderly. This method fuses speech, face, physiological and interaction information, constructs a convolutional coding, bidirectional temporal modeling and cross-modal attention coordination framework, and realizes the stable discrimination of emotional states in the elderly. On this basis, a recommendation mechanism combining user preference, historical feedback and music content characteristics is introduced to form a closed loop of “identification-recommendation-update”. The experimental results show that the Accuracy, Macro-F1 and AUC of the proposed model reach 93.84%, 92.47%and 95.12%respectively. After 4 weeks of intervention, the emotional improvement rate of the experimental group increases to 27.6%, and the average inference delay of the system is 23.6 ms. The research shows that this method has good application potential in intelligent elderly care and digital music therapy scenarios.

 

Keywords
emotion recognition in the elderly; Deep learning; Personalized music therapy; Multimodal fusion

Related Articles

Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China
Ken Wang1, Jinhan Shu2, Kan Yuan1
1School of Digital Media, Shenzhen Polytechnic University, Shenzhen 518055, Guangdong, China
2Postdoctoral Mobile Station of Journalism and communication, Fudan University, Shanghai 200433, Shanghai, China