Outline

Ingegneria Sismica

Ingegneria Sismica

Research on Deep Learning-Based Vocal Separation and Digital Synthesis in Choral Music

Author(s): Luanyu Zhao1
1Department of International Studies, Chugye University for Arts, Seodaemun-gu, Seoul, 03762, Korea
Zhao, Luanyu. “Research on Deep Learning-Based Vocal Separation and Digital Synthesis in Choral Music.” Ingegneria Sismica Volume 43 Issue 2: 1-18, doi:10.65102/is2026643.

Abstract

With the advancement of computer performance, audio processing technology has also achieved significant development. This study explores the application of deep learning in audio separation and music synthesis, introducing deep recurrent neural networks into audio separation to construct a choral voice separation model. It further proposes a choral vocal synthesis system encompassing both training and synthesis, built upon deep neural networks. Experimental results demonstrate that the DNN-based choral voice separation algorithm effectively isolates vocals from accompaniment. The separated choral vocals achieve a significantly higher PESQ score of 3.32 compared to both the original track and accompaniment, outperforming comparison algorithms by 26.82% to 35.10%. The DNN model achieved musical metrics close to the original, with errors under 10%. Its generated choral music demonstrated lower TER values across all vocal parts compared to other algorithms, remaining within 5%, indicating excellent choral vocal synthesis performance. This method enables high-quality vocal separation and generation, showcasing its potential applications in music creation.

Keywords
Deep learning; Deep recurrent neural network; Deep neural network; Sound separation; Vocal synthesis

Related Articles

Huiqiao Liu1
1Yinchuan University of Energy, Ningxia, 750000, China
Xin Zhao1, Yan Li1, Xiangyang Cao1, Qiushuang Li1, Jianing Zhang1
1State Grid Shandong Electric Power Company Economic and Technological Research Institute ShanDong JiNan 250001, China
Dan Yang1
1School of Marxism, Suzhou Polytechnic University, Suzhou, 215104, China
Liuhang Shen1, Xiangwen Sun1
1Ulster college at Shaanxi University of Science &Technology, Xi’an,710021, Shaanxi, China