Outline

Ingegneria Sismica

Ingegneria Sismica

Application of deep learning model with multi-modal data fusion in clothing comfort prediction

Author(s): Miao Yu1
1Faculty of Art and Design, Shanghai Business School, Shanghai, 200235, China
Yu, Miao. “Application of deep learning model with multi-modal data fusion in clothing comfort prediction.” Ingegneria Sismica Volume 43 Issue 2: 1-25, doi:10.65102/is2026969.

Abstract

Aiming at the problems of insufficient representation of single data source, fixed modal fusion weight and low prediction accuracy of continuous comfort score in clothing comfort prediction, a multimodal data fusion deep learning prediction model was constructed. Taking clothing images, human heat and humidity pressure sensing sequences, fabric structural parameters and environmental variables as input, the model uses convolution branch, bidirectional gated recurrent branch and structured coding branch to extract heterogeneous features, and completes dynamic weight allocation through cross-modal attention layer to output comfort level and continuous comfort score. The validation was carried out based on the GarmentComfort-MM dataset, and the total number of samples was 7200 groups. The experimental results show that the Accuracy, Precision, Recall and F1-score of the model on the test set reach 93.8%, 93.4%, 92.9% and 93.1%, respectively. The MAE and RMSE of the continuous comfort score prediction are 0.041 and 0.058, respectively. The Accuracy decreases by 4.6 percentage points after removing the sensing branch, which indicates that the dynamic information of heat and humidity pressure contributes significantly to the comfort prediction. The research can provide technical support for the intelligent evaluation of clothing comfort.

Keywords
Multimodal data fusion; Deep learning; Clothing comfort; Prediction model

Related Articles

Huiqiao Liu1
1Yinchuan University of Energy, Ningxia, 750000, China
Xin Zhao1, Yan Li1, Xiangyang Cao1, Qiushuang Li1, Jianing Zhang1
1State Grid Shandong Electric Power Company Economic and Technological Research Institute ShanDong JiNan 250001, China
Dan Yang1
1School of Marxism, Suzhou Polytechnic University, Suzhou, 215104, China
Liuhang Shen1, Xiangwen Sun1
1Ulster college at Shaanxi University of Science &Technology, Xi’an,710021, Shaanxi, China