Outline

Ingegneria Sismica

Ingegneria Sismica

Choral Works Style Transfer and Voice Part Balance Algorithm based on Generative adversarial networks

Author(s): Zhipeng Li1
1School of Music and Dance, Lanzhou University of Arts and Science, Lanzhou, 730000, Gansu, China
Li, Zhipeng. “Choral Works Style Transfer and Voice Part Balance Algorithm based on Generative adversarial networks.” Ingegneria Sismica Volume 43 Issue 1: 1-21, doi:10.65102/is2026310.

Abstract

With the continuous development of artificial intelligence technology and deep learning methods in the field of music information processing, style transfer and multi-voice balance control of choral works have gradually become an important issue in computational musicology. This paper aims to construct a style transfer and voice part balance algorithm for choral works based on generative adversarial networks. Based on 312 choral works and 6840 valid sample fragments, this study jointly collects audio and music data, and completes the unified preprocessing through timing alignment, loudness normalization and multi-modal feature coding. Focusing on the characteristics of chorus style expression and voice organization, we extract information such as spectrum envelope, harmony density, rhythm intensity and voice energy ratio, and introduce cycle consistency constraint, content preservation constraint and voice balance regularization term into the bidirectional generative adversarial framework to realize the collaborative modeling of chorus style transfer and hierarchical optimization. Experimental results show that the proposed method achieves 0.87, 91.6%, 0.041 and 4.36 in style similarity, main melody retention rate, voice part balance error and subjective listening score, respectively, which are better than basic CycleGAN, Transformer-GAN and AutoMix-Net. The results show that the algorithm has good application value in chorus intelligent composition and digital music processing.

Keywords
Generative adversarial networks; Choral style transfer; Voice balance; Computational musicology

Related Articles

Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China
Ken Wang1, Jinhan Shu2, Kan Yuan1
1School of Digital Media, Shenzhen Polytechnic University, Shenzhen 518055, Guangdong, China
2Postdoctoral Mobile Station of Journalism and communication, Fudan University, Shanghai 200433, Shanghai, China