Outline

Ingegneria Sismica

Ingegneria Sismica

A Hybrid Transfer Learning and Multi-Task Framework for Cross-Domain Image Classification.

Author(s): Ruimeng Zhang1
1School of Future and Technologies, Beijing Institute of Technology, Beijing 100081, Beijing, China
Zhang, Ruimeng. “A Hybrid Transfer Learning and Multi-Task Framework for Cross-Domain Image Classification..” Ingegneria Sismica Volume 43 Issue 2: 1-16, doi:10.65102/is2026860.

Abstract

As one of the needs of computer vision, image content recognition is the process of identifying objects and scenes in an image through learning visual representations. A fixed ResNet50 backbone and multi-task learning for the contents of images are proposed as the hybrid deep learning model in this paper. The model is also used to regress features and classify images by way of shared representation learning. The Office-Home dataset is employed for the experimental work because it comprises 65 kinds of objects and several visual domains. The classification accuracy and F1 score of the proposed framework are about 74% and 0.73, respectively; thus, good feature learning and domain adaptation have been achieved. Ablation experiments have confirmed that the proposed strategies of data augmentation, depth of backbones and stabilisation during training (such as early stopping and learning rate schedules) are indeed effective. Although the regression branch is less semantically interpretable due to the use of one-hot targets, all the results show that the proposed framework will provide a good and effective basis for tasks requiring the understanding of image content. Based on the above results, we can analyze the strengths and weaknesses of learning about multi-task in real-world applications of computer vision.

Keywords
Image Content Understanding, Computer Vision, Deep Learning, Multi-Task Learning, ResNet50, Image Classification

Related Articles

Huiqiao Liu1
1Yinchuan University of Energy, Ningxia, 750000, China
Xin Zhao1, Yan Li1, Xiangyang Cao1, Qiushuang Li1, Jianing Zhang1
1State Grid Shandong Electric Power Company Economic and Technological Research Institute ShanDong JiNan 250001, China
Dan Yang1
1School of Marxism, Suzhou Polytechnic University, Suzhou, 215104, China
Liuhang Shen1, Xiangwen Sun1
1Ulster college at Shaanxi University of Science &Technology, Xi’an,710021, Shaanxi, China