Outline

Ingegneria Sismica

Ingegneria Sismica

A Dynamic Interaction-oriented Reinforcement Learning Framework for AI-Assisted Piano Improvisation Accompaniment – From Melodic Adaptation to Stylistic Evolution

Author(s): Yilin Wang1
1Conservatory of Music, Taizhou College of Nanjing Normal University, Taizhou, Jiangsu, 225300, China
Wang, Yilin. “A Dynamic Interaction-oriented Reinforcement Learning Framework for AI-Assisted Piano Improvisation Accompaniment – From Melodic Adaptation to Stylistic Evolution.” Ingegneria Sismica Volume 43 Issue 1: 1-19, doi:10.65102/is2026377.

Abstract

Piano improvisation accompaniment ability, as an important part of piano education, lacks scientific and effective teaching means and cannot be well adapted to the intelligent era. In this paper, we focus on melodic adaptation and stylistic evolution to build a dynamic interactive intelligent piano accompaniment generation framework. The framework is based on the extraction of piano music features, based on the Mido library to realize the preliminary analysis of MIDI files, combined with the event information of different tracks to obtain the note feature matrix. Then, oriented to classical reinforcement learning RLTUNER baseline model, LSTM gates are used as inputs for optimization to generate piano accompaniment melodies. On the other hand, in this paper, rhythmic features are used as the stylistic representation of piano music, and Actor and Critic are used as the generative and discriminative networks to construct the rhythm generation mechanism, respectively. It is found that the generative framework of this paper has high accuracy and strong generalization ability in multi-track processing, with an accuracy rate of 89.78% and an error rate of only 0.047% in the test set. Meanwhile, the accompaniment music generation results effectively balance originality and recognizability, and are recognized by the audience.

Keywords
piano improvisation accompaniment; reinforcement learning; RLTUNER baseline model; LSTM; melody generation

Related Articles

Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China
Ken Wang1, Jinhan Shu2, Kan Yuan1
1School of Digital Media, Shenzhen Polytechnic University, Shenzhen 518055, Guangdong, China
2Postdoctoral Mobile Station of Journalism and communication, Fudan University, Shanghai 200433, Shanghai, China