Outline

Ingegneria Sismica

Ingegneria Sismica

Deep Reconstruction of Image Style for Intangible Cultural Heritage and Adaptive Enhancement Model for Visual Features

Author(s): Lili Zhang1, Yu Fang1
1Jingchu University of Technology, Jingmen City, Hubei Province, China 448000
Zhang, Lili. and Fang, Yu. “Deep Reconstruction of Image Style for Intangible Cultural Heritage and Adaptive Enhancement Model for Visual Features.” Ingegneria Sismica Volume 43 Issue 2: 1-13, doi:10.65102/is2026943.

Abstract

Digital reproduction of ICH images should consider both the style fidelity and cultural semantic expression. Given that the existing methods are prone to losing the unique visual grammar of ICH in reconstruction, this paper proposes a joint model for deep reconstruction of ICH artistic image style and adaptive enhancement of visual features to address this problem. Gram matrix is used to extract the embedding of ICH style from the model, and then combined with the improved ICH-AdaIN mechanism to achieve decoupled reconstruction of content and style. An adaptive vision-enhancement module that is guided by cultural attention will be added to strengthen the foundation of culture. Experiments have been conducted on 1,280 image datasets of the four types of ICH, such as New Year pictures and paper-cuts; compared with the U-Net baseline, the proposed method reduced LPIPS-style by 27% and FID by 15.3, increased local SSIM to 0.91 in key areas, and reduced the standard deviation of background noise by 12%. The expert’s score reached 4.3/5 and had risen from the original 2.8/5. According to the above results, the model can reconstruct high-quality images that meet the visual requirements of ICH, and is thus suitable for use in digital protection and activation applications.

Keywords
Intangible heritage; Image style reconstruction; Adaptive enhancement; ICH-AdaIN; Cultural attention

Related Articles

Qianwen Xiong1, Yuhong Chen1
1Guangzhou University of Chinese Medicine, School of Pharmaceutical Medicine, Guangzhou,Guangdong,China,510006
Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China