Outline

Ingegneria Sismica

Ingegneria Sismica

Research on the migration technology of animation character emotion expression based on multimodal fusion and attention mechanism

Author(s): Xiawei Lu1
1College of Architecture and Art, Taiyuan University of Technology, Jinzhong, Shanxi, 030600, China
Lu, Xiawei. “Research on the migration technology of animation character emotion expression based on multimodal fusion and attention mechanism.” Ingegneria Sismica Volume 43 Issue 1: 1-18, doi:10.65102/is2026260.

Abstract

In this paper, we design a multimodal sequence feature extraction model based on self-attention mechanism and propose an improved RoBERTa-MEN to realize emotion classification. Combined with the influence of cognition on emotion, the animated character emotion modeling and behavior modeling methods are optimized. Select mainstream models for emotion recognition performance comparison to explore the superiority of the proposed method. Combine the results of correlation visualization analysis to verify the effectiveness of the improvement scheme in this paper. Conduct an animated character emotion transfer experiment to analyze the feasibility of the proposed method. In the performance test, the four indexes of this paper’s model are improved by 1.5%~2.5% than the TBJE model. The research on the effectiveness of facial emotion shows that the classification accuracy of this paper’s model in seven emotion labels is above 80%, and the average value of the emotion index evaluation reaches 82 points. It proves that the scheme of this paper can integrate multimodal data and realize the effective characterization and transfer of animated characters’ emotions.

Keywords
animated characters; self-attention mechanism; multimodal sequence characterization; emotion classification; emotion migration

Related Articles

Qianwen Xiong1, Yuhong Chen1
1Guangzhou University of Chinese Medicine, School of Pharmaceutical Medicine, Guangzhou,Guangdong,China,510006
Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China