Outline

Ingegneria Sismica

Ingegneria Sismica

Dynamic Visualization Method of Vocal Melody Based on Audio Feature Extraction and Image Processing

Author(s): Dihua Zhang1, Jia Kuang1
1College of Music, Hengyang Normal University, Hengyang 421001, Hunan, China
Zhang, Dihua. and Kuang, Jia . “Dynamic Visualization Method of Vocal Melody Based on Audio Feature Extraction and Image Processing.” Ingegneria Sismica Volume 43 Issue 1: 1-16, doi:10.65102/is2026345.

Abstract

With the rapid development of computer technology, the dynamic visualization of vocal music melody has attracted more and more attention. The dynamic visualization of vocal music melody is a way of expression and presentation of music. The dynamic visualization of vocal music melody is a way to express more music information in various forms with vision as the center and with music, which is a new form of cultural exchange in the information age. This paper focused on the dynamic visualization of vocal melody, and proposed audio feature extraction based on auto correlation function (ACF) and improved ACF algorithm. The improved ACF algorithm was more efficient in extracting audio features, which was also conducive to the dynamic visualization of vocal music melody. The experimental results in this paper showed that the extraction time of ACF algorithm and improved ACF algorithm on MIR-1K dataset was 10.8s and 3.6s respectively when the pitch was 180, and the extraction time of ACF algorithm and improved ACF algorithm on MedleyDB dataset was 12.3s and 2.8s respectively when the pitch was 180. It can be found that the extraction time of the improved ACF algorithm was less than that of the ACF algorithm, which also showed that the improved ACF algorithm had higher extraction efficiency.

Keywords
Visualization of Vocal Melody, Auto-correlation Function, Audio Feature Extraction, Image Processing

Related Articles

Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China
Ken Wang1, Jinhan Shu2, Kan Yuan1
1School of Digital Media, Shenzhen Polytechnic University, Shenzhen 518055, Guangdong, China
2Postdoctoral Mobile Station of Journalism and communication, Fudan University, Shanghai 200433, Shanghai, China