Outline

Ingegneria Sismica

Ingegneria Sismica

Music Visualization Design Method Based on Multi Audio Features of Video Image Processing Technology

Author(s): Xin Chen1, Liqiong Duan2, Xiaowei Liu3
1Vocal Music, Sookmyung Women’s University, Seoul, 04310, Korea
2Admissions Office, Zhangjiakou Open University, Zhangjiakou 075000, Hebei, China
3Sangmyung University, Seoul, 04310, Korea
Chen, Xin., Duan, Liqiong., and Liu, Xiaowei. “Music Visualization Design Method Based on Multi Audio Features of Video Image Processing Technology.” Ingegneria Sismica Volume 43 Issue 1: 1-17, doi:10.65102/is2026338.

Abstract

With the development of music visualization, people are more and more likely to accept it, and people unconsciously form a different concept of music art. Among them, image processing technology is an important part of music visualization design. In audio multi feature extraction, preprocessing is the first step of speech signal analysis. After a certain preprocessing process, the sound signal can be converted into a data format that can be processed by algorithms and computers. The specific steps are MIDI file note extraction, theme extraction, segment segmentation, and segment feature extraction. In the overall design of music visualization, this paper proposed two design schemes for different music forms. One is for different music characteristics, and the other is to use a single or combined way to enrich the music visual effect. Different main and secondary melodies (pitch, beat, speed, time fractal dimension, etc.) would produce different visual effects. The classification accuracy of metal music, classical music and folk music in this paper was 93%, 92.7% and 93.3% respectively. The visualization method mentioned in this paper is more targeted and has better implementation effect.

Keywords
Music Visualization, Multi Audio Features, Video Image Processing Technology, MIDI Files

Related Articles

Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China
Ken Wang1, Jinhan Shu2, Kan Yuan1
1School of Digital Media, Shenzhen Polytechnic University, Shenzhen 518055, Guangdong, China
2Postdoctoral Mobile Station of Journalism and communication, Fudan University, Shanghai 200433, Shanghai, China