Outline

Ingegneria Sismica

Ingegneria Sismica

Research on the migration technology of animation character emotion expression based on multimodal fusion and attention mechanism

Author(s): Xiawei Lu1
1College of Architecture and Art, Taiyuan University of Technology, Jinzhong, Shanxi, 030600, China
Lu, Xiawei. “Research on the migration technology of animation character emotion expression based on multimodal fusion and attention mechanism.” Ingegneria Sismica Volume 43 Issue 1: 1-18, doi:10.65102/is2026260.

Abstract

In this paper, we design a multimodal sequence feature extraction model based on self-attention mechanism and propose an improved RoBERTa-MEN to realize emotion classification. Combined with the influence of cognition on emotion, the animated character emotion modeling and behavior modeling methods are optimized. Select mainstream models for emotion recognition performance comparison to explore the superiority of the proposed method. Combine the results of correlation visualization analysis to verify the effectiveness of the improvement scheme in this paper. Conduct an animated character emotion transfer experiment to analyze the feasibility of the proposed method. In the performance test, the four indexes of this paper’s model are improved by 1.5%~2.5% than the TBJE model. The research on the effectiveness of facial emotion shows that the classification accuracy of this paper’s model in seven emotion labels is above 80%, and the average value of the emotion index evaluation reaches 82 points. It proves that the scheme of this paper can integrate multimodal data and realize the effective characterization and transfer of animated characters’ emotions.

Keywords
animated characters; self-attention mechanism; multimodal sequence characterization; emotion classification; emotion migration

Related Articles

Huiqiao Liu1
1Yinchuan University of Energy, Ningxia, 750000, China
Xin Zhao1, Yan Li1, Xiangyang Cao1, Qiushuang Li1, Jianing Zhang1
1State Grid Shandong Electric Power Company Economic and Technological Research Institute ShanDong JiNan 250001, China
Dan Yang1
1School of Marxism, Suzhou Polytechnic University, Suzhou, 215104, China
Liuhang Shen1, Xiangwen Sun1
1Ulster college at Shaanxi University of Science &Technology, Xi’an,710021, Shaanxi, China