Outline

Ingegneria Sismica

Ingegneria Sismica

A Hybrid Transfer Learning and Multi-Task Framework for Cross-Domain Image Classification.

Author(s): Ruimeng Zhang1
1School of Future and Technologies, Beijing Institute of Technology, Beijing 100081, Beijing, China
Zhang, Ruimeng. “A Hybrid Transfer Learning and Multi-Task Framework for Cross-Domain Image Classification..” Ingegneria Sismica Volume 43 Issue 2: 1-16, doi:10.65102/is2026860.

Abstract

As one of the needs of computer vision, image content recognition is the process of identifying objects and scenes in an image through learning visual representations. A fixed ResNet50 backbone and multi-task learning for the contents of images are proposed as the hybrid deep learning model in this paper. The model is also used to regress features and classify images by way of shared representation learning. The Office-Home dataset is employed for the experimental work because it comprises 65 kinds of objects and several visual domains. The classification accuracy and F1 score of the proposed framework are about 74% and 0.73, respectively; thus, good feature learning and domain adaptation have been achieved. Ablation experiments have confirmed that the proposed strategies of data augmentation, depth of backbones and stabilisation during training (such as early stopping and learning rate schedules) are indeed effective. Although the regression branch is less semantically interpretable due to the use of one-hot targets, all the results show that the proposed framework will provide a good and effective basis for tasks requiring the understanding of image content. Based on the above results, we can analyze the strengths and weaknesses of learning about multi-task in real-world applications of computer vision.

Keywords
Image Content Understanding, Computer Vision, Deep Learning, Multi-Task Learning, ResNet50, Image Classification

Related Articles

Junhua Li1, Xiaojie He1, Hua Liu2
1School of Mathematics and Computer Science, Hanjiang Normal University, Shiyan, 442000, Hubei, China
2School of Mathematics and Physics, Jingchu University of Technology, Jingmen 448000, Hubei, China
Wei Guo1, Peng Tao1, Bo Ling1, Shen Hao1, Nan Kai1
1State Grid Hebei Marketing Service Center, Shijiazhuang 050000, Hebei, China
Tianzi Zheng1, Genlang Chen2, Binhua He1
1School of Computer Science and Technology (School of Artificial Intelligence), Zhejiang Sci-Tech University, Hangzhou 310018, China
2School of Computer and Data Engineering, Ningbo Tech University, Ningbo 315199, China
Jingwen Wu1
1School of Business, Minnan Normal University, Zhangzhou 363000, Fujian, China
Zijie Peng1, Qianhua Xiao2
1JiLuan College, Nanchang University, Jiangxi 330031, Nanchang, China
2College of Information Engineering, Nanchang University, Jiangxi 330031, Nanchang, China