Outline

Ingegneria Sismica

Ingegneria Sismica

Deep Neural Networks for Vocal Emotion Analysis Listener Response Prediction

Author(s): Haiwang Yang1
1School of Educational Sciences, Zhaotong University, Zhaotong 657000, Yunnan Province, China
Yang, Haiwang. “Deep Neural Networks for Vocal Emotion Analysis Listener Response Prediction.” Ingegneria Sismica Volume 43 Issue 1: 1-20, doi:10.65102/is2026082.

Abstract

For digital music dissemination and intelligent audio analysis scenarios, this paper constructs a deep neural network model around the problem of audience reaction prediction in vocal emotion analysis. Based on the time-frequency feature extraction and preprocessing of human voice audio, the model uses the fully convolutional network to extract the spatial information in the spectral domain, combines the bidirectional long short-term memory network to capture the time dependence of emotion in phrase progression, and introduces the context attention fusion mechanism to adaptively weight the key frequency band, key frame and cross-segment association information. Thus a computational mapping between vocal expression and listener feedback is established. The experimental results show that the accuracy of the model on the human voice emotion recognition task reaches 91.8%, and the macro-average F1 value is 91.1%. In the listener response prediction task, the mean absolute errors of preference prediction and arousal prediction are reduced to 0.356 and 0.339, respectively. The results show that the proposed model can stably improve the accuracy of emotion analysis and the ability of listener feedback prediction in complex vocal clips.

Keywords
Deep neural network; Vocal emotion analysis; Listener response prediction; Spatio-temporal feature fusion

Related Articles

Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China
Ken Wang1, Jinhan Shu2, Kan Yuan1
1School of Digital Media, Shenzhen Polytechnic University, Shenzhen 518055, Guangdong, China
2Postdoctoral Mobile Station of Journalism and communication, Fudan University, Shanghai 200433, Shanghai, China