Outline

Ingegneria Sismica

Ingegneria Sismica

Using Image Recognition Technology to Assist in Music Score Recognition and Instruction in Distance Music Education

Author(s): Dan Shen1, Xuandong Sun2
1School of Art, South China University of Technology, Guangzhou, 510006, China
2School of Computer Science and Technology, Guangdong University of Technology, Guangzhou, 510006, China
Shen, Dan. and Sun, Xuandong. “Using Image Recognition Technology to Assist in Music Score Recognition and Instruction in Distance Music Education.” Ingegneria Sismica Volume 43 Issue 2: 1-17, doi:10.65102/is2026755.

Abstract

Addressing the challenges in remote music education-such as the complex sources of sheet music images, significant variations in image quality, the heavy burden of manual identification on teachers, and the difficulty of directly applying recognition results to teaching-this paper focuses on the structural restoration of low-quality classroom sheet music images and the generation of instructional prompts. This paper at first builds a music score data arrangement plan which is specially made for remote teaching situations, it unites publicly obtainable OMR data together with screenshots, mobile telephone pictures, classroom video frames, and teacher-marked manuscripts under one single training and evaluation frame. This hereby constructs the RemoteScore-Teach data object, which has the integration of symbol-level annotations, MusicXML alignment outcomes, and bar-level teaching-oriented labels. Building on this foundation, we propose the STG-OMR model, which integrates visual encoding, positional embedding, scale embedding, symbol relationship modeling, sequence decoding, and instructional hint generation into a single recognition pipeline. This enables the system to simultaneously output structured musical score results and bar-level instructional hints. Experimental results demonstrate that the proposed method achieves superior performance on both public benchmarks and remote teaching test sets, with Symbol F1, SeqAcc, and Hint-P may attain 95.4%, 91.7%, and 89.3% upon RemoteScore-Teach, respectively, and it displays higher stability in the situations which include photographed scores, reflective screen captures and annotated scores. The cutting experiments further prove that the score position prior information, the relation graph restriction conditions and the teaching hint branch structure are the main sources that bring performance promotion. This research provides practical technical support for pre-class preparation, in-class identification of key measures, and post-class assignment screening, while also offering a new implementation path for intelligent score analysis in remote music education.

Keywords
remote music education; music score recognition; optical music score recognition; instructional prompt generation; structured score analysis

Related Articles

Qianwen Xiong1, Yuhong Chen1
1Guangzhou University of Chinese Medicine, School of Pharmaceutical Medicine, Guangzhou,Guangdong,China,510006
Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China