Outline

Ingegneria Sismica

Ingegneria Sismica

Research on Deep Learning-Based Vocal Separation and Digital Synthesis in Choral Music

Author(s): Luanyu Zhao1
1Department of International Studies, Chugye University for Arts, Seodaemun-gu, Seoul, 03762, Korea
Zhao, Luanyu. “Research on Deep Learning-Based Vocal Separation and Digital Synthesis in Choral Music.” Ingegneria Sismica Volume 43 Issue 2: 1-18, doi:10.65102/is2026643.

Abstract

With the advancement of computer performance, audio processing technology has also achieved significant development. This study explores the application of deep learning in audio separation and music synthesis, introducing deep recurrent neural networks into audio separation to construct a choral voice separation model. It further proposes a choral vocal synthesis system encompassing both training and synthesis, built upon deep neural networks. Experimental results demonstrate that the DNN-based choral voice separation algorithm effectively isolates vocals from accompaniment. The separated choral vocals achieve a significantly higher PESQ score of 3.32 compared to both the original track and accompaniment, outperforming comparison algorithms by 26.82% to 35.10%. The DNN model achieved musical metrics close to the original, with errors under 10%. Its generated choral music demonstrated lower TER values across all vocal parts compared to other algorithms, remaining within 5%, indicating excellent choral vocal synthesis performance. This method enables high-quality vocal separation and generation, showcasing its potential applications in music creation.

Keywords
Deep learning; Deep recurrent neural network; Deep neural network; Sound separation; Vocal synthesis

Related Articles

Qianwen Xiong1, Yuhong Chen1
1Guangzhou University of Chinese Medicine, School of Pharmaceutical Medicine, Guangzhou,Guangdong,China,510006
Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China