Outline

Ingegneria Sismica

Ingegneria Sismica

A Hybrid Transfer Learning and Multi-Task Framework for Cross-Domain Image Classification.

Author(s): Ruimeng Zhang1
1School of Future and Technologies, Beijing Institute of Technology, Beijing 100081, Beijing, China
Zhang, Ruimeng. “A Hybrid Transfer Learning and Multi-Task Framework for Cross-Domain Image Classification..” Ingegneria Sismica Volume 43 Issue 2: 1-16, doi:10.65102/is2026860.

Abstract

As one of the needs of computer vision, image content recognition is the process of identifying objects and scenes in an image through learning visual representations. A fixed ResNet50 backbone and multi-task learning for the contents of images are proposed as the hybrid deep learning model in this paper. The model is also used to regress features and classify images by way of shared representation learning. The Office-Home dataset is employed for the experimental work because it comprises 65 kinds of objects and several visual domains. The classification accuracy and F1 score of the proposed framework are about 74% and 0.73, respectively; thus, good feature learning and domain adaptation have been achieved. Ablation experiments have confirmed that the proposed strategies of data augmentation, depth of backbones and stabilisation during training (such as early stopping and learning rate schedules) are indeed effective. Although the regression branch is less semantically interpretable due to the use of one-hot targets, all the results show that the proposed framework will provide a good and effective basis for tasks requiring the understanding of image content. Based on the above results, we can analyze the strengths and weaknesses of learning about multi-task in real-world applications of computer vision.

Keywords
Image Content Understanding, Computer Vision, Deep Learning, Multi-Task Learning, ResNet50, Image Classification

Related Articles

Zijie Peng1, Qianhua Xiao2
1JiLuan College, Nanchang University, Jiangxi 330031, Nanchang, China
2College of Information Engineering, Nanchang University, Jiangxi 330031, Nanchang, China
Wanwan Dong1
1School of Management, Jiangsu University, Zhenjiang, Jiangsu, China 212013
Haibo Tian1, Haipeng Niu1, Kangmin Ji1, Zhiheng Zhou1
1College of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, Shaanxi, China
Chuanqi Lao1
1Economics and Management School of Sichuan Tourism College, Chendu 610100, Sichuan, China
Yujia Li1
1School of Electronic and Information Engineering, South China University of Technology, Guangzhou 510640, China