Outline

Ingegneria Sismica

Ingegneria Sismica

AI-assisted cross-cultural delivery of traditional musical art forms in contemporary times

Author(s): Yujia Yang1, Dan Shen2, Xuandong Sun3
1College of Music, Luoyang Normal University, Luoyang 471934, Henan, China
2School of Art, South China University of Technology,Guangzhou,510006,China
3School of Computer Science and Technology, Guangdong University of Technology, Guangzhou,510006,China
Yang, Yujia., Shen, Dan., and Sun, Xuandong. “AI-assisted cross-cultural delivery of traditional musical art forms in contemporary times.” Ingegneria Sismica Volume 43 Issue 2: 1-20, doi:10.65102/is2026524.

Abstract

As a cultural subject, traditional music and art are facing the technical problem of incompatible conversion forms in the inheritance and development of modern society. In this paper, we take “music score recognition – music visualization – cross-cultural transmission” as the research idea, and focus on constructing the application framework of AI technology. The detailed features of musical notes are extracted using Harr wavelet transform, and the note contour layer is processed by 1D convolution operation, and a multi-scale feature fusion CRNN framework is established for sheet music recognition. After completing the transcription of musical notes, the VGGish model is used to process the music data, and the t-SNE algorithm is used to visualize the music data, forming a cross-cultural output scheme for traditional music art. In the practical application of this scheme, the effect of music performance was recognized by 80.00% and above of the subjects, and the visualization effect was positively evaluated by 67.27% of the subjects, which is an effective development path for the traditional music art form to fit into the contemporary society under the AI technology.

Keywords
music score recognition; VGGish model; t-SNE; music visualization; traditional music

Related Articles

Qianwen Xiong1, Yuhong Chen1
1Guangzhou University of Chinese Medicine, School of Pharmaceutical Medicine, Guangzhou,Guangdong,China,510006
Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China