Outline

Ingegneria Sismica

Ingegneria Sismica

Choral Works Style Transfer and Voice Part Balance Algorithm based on Generative adversarial networks

Author(s): Zhipeng Li1
1School of Music and Dance, Lanzhou University of Arts and Science, Lanzhou, 730000, Gansu, China
Li, Zhipeng. “Choral Works Style Transfer and Voice Part Balance Algorithm based on Generative adversarial networks.” Ingegneria Sismica Volume 43 Issue 1: 1-21, doi:10.65102/is2026310.

Abstract

With the continuous development of artificial intelligence technology and deep learning methods in the field of music information processing, style transfer and multi-voice balance control of choral works have gradually become an important issue in computational musicology. This paper aims to construct a style transfer and voice part balance algorithm for choral works based on generative adversarial networks. Based on 312 choral works and 6840 valid sample fragments, this study jointly collects audio and music data, and completes the unified preprocessing through timing alignment, loudness normalization and multi-modal feature coding. Focusing on the characteristics of chorus style expression and voice organization, we extract information such as spectrum envelope, harmony density, rhythm intensity and voice energy ratio, and introduce cycle consistency constraint, content preservation constraint and voice balance regularization term into the bidirectional generative adversarial framework to realize the collaborative modeling of chorus style transfer and hierarchical optimization. Experimental results show that the proposed method achieves 0.87, 91.6%, 0.041 and 4.36 in style similarity, main melody retention rate, voice part balance error and subjective listening score, respectively, which are better than basic CycleGAN, Transformer-GAN and AutoMix-Net. The results show that the algorithm has good application value in chorus intelligent composition and digital music processing.

Keywords
Generative adversarial networks; Choral style transfer; Voice balance; Computational musicology

Related Articles

Huiqiao Liu1
1Yinchuan University of Energy, Ningxia, 750000, China
Xin Zhao1, Yan Li1, Xiangyang Cao1, Qiushuang Li1, Jianing Zhang1
1State Grid Shandong Electric Power Company Economic and Technological Research Institute ShanDong JiNan 250001, China
Dan Yang1
1School of Marxism, Suzhou Polytechnic University, Suzhou, 215104, China
Liuhang Shen1, Xiangwen Sun1
1Ulster college at Shaanxi University of Science &Technology, Xi’an,710021, Shaanxi, China