Outline

Ingegneria Sismica

Ingegneria Sismica

Design and implementation of Intelligent Composition generation Model driven by Multi-modal music features

Author(s): Lianghua Li1
1Hunan First Normal University the College of Music and Dance. Chang sha 410205, P. R. China
Li, Lianghua. “Design and implementation of Intelligent Composition generation Model driven by Multi-modal music features.” Ingegneria Sismica Volume 43 Issue 1: 1-21, doi:10.65102/is2026215.

Abstract

Generative artificial intelligence (AI) has accelerated its entry into digital content production scenarios and promoted the evolution of intelligent composition from single sequence prediction to multi-modal collaborative modeling. Aiming at the composition task driven by multi-modal music features, this paper constructs a generative model that integrates audio, MIDI, lyric text, style labels and emotion labels. Through unified feature representation, cross-modal attention fusion, hierarchical sequence generation, melody rhythm and harmony synergy constraints, as well as bi-conditional modulation of style and emotion and structure verification of music score. The closed-loop design from feature input to symbolic output is realized. Experimental results show that the melody coherence, style matching and emotional accuracy of the model reach 91, 90 and 87 points respectively, and the comprehensive quality score is 88.4, which is still 84.7 under 20% disturbance. In the lyric-assisted composition scene, the comprehensive score is 89.1, and the style preservation rate is 91.4%. The research shows that this method can improve the structure stability and expression consistency of the generated music, which has reference significance for the engineering implementation of intelligent composition system.

Keywords
Multi-modal music feature; Intelligent composition; Music generation model; Cross-modal fusion

Related Articles

Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China
Ken Wang1, Jinhan Shu2, Kan Yuan1
1School of Digital Media, Shenzhen Polytechnic University, Shenzhen 518055, Guangdong, China
2Postdoctoral Mobile Station of Journalism and communication, Fudan University, Shanghai 200433, Shanghai, China