Outline

Ingegneria Sismica

Ingegneria Sismica

Comparison and classification of dunhuang murals and medieval European musical instrument images from a cross-cultural perspective

Author(s): Haixiang Gao1
1School of Contemporary Music and Technology, Nanjing University of Arts, NanJing, 210000, China
Gao, Haixiang. “Comparison and classification of dunhuang murals and medieval European musical instrument images from a cross-cultural perspective.” Ingegneria Sismica Volume 43 Issue 1: 1-23, doi:10.65102/is2026089.

Abstract

This paper proposes a cross-cultural classification method for images of Dunhuang murals and medieval European Musical Instruments. A dataset of 9216 images covering 16 musical instrument categories was constructed, with 4768 Dunhuang samples and 4448 European samples. The framework uses region clipping, label normalization and block-level coding, introduces hierarchical visual semantic alignment and adaptive gated fusion, and maps heterogeneous cultural cues into the discriminant space. A two-branch classifier is designed to extract the organ-shaped commonalities while preserving the details. The focus classification loss, contras alignment loss and domain constraint regularization term are jointly optimized in training to stabilize class boundaries. Experimental results show that the proposed method achieves 94.8% Accuracy, 93.6% Macro-F1 and 92.4% CDR, which are better than the ResNet50, Swin-T and CLIP-Linear baselines. The test results show that the misjudgment proportion of harp and harp is less than 6.3%, and the confusion rate of harp and harp is reduced to 8.1%, which indicates that the model can provide computational support for cross-cultural instrument analysis, cataloguing and knowledge organization.

Keywords
Dunhuang mural; Medieval European musical instrument images; Cross-cultural image classification; Visual semantic alignment

Related Articles

Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China
Ken Wang1, Jinhan Shu2, Kan Yuan1
1School of Digital Media, Shenzhen Polytechnic University, Shenzhen 518055, Guangdong, China
2Postdoctoral Mobile Station of Journalism and communication, Fudan University, Shanghai 200433, Shanghai, China