Outline

Ingegneria Sismica

Ingegneria Sismica

A Hybrid Transfer Learning and Multi-Task Framework for Cross-Domain Image Classification.

Author(s): Ruimeng Zhang1
1School of Future and Technologies, Beijing Institute of Technology, Beijing 100081, Beijing, China
Zhang, Ruimeng. “A Hybrid Transfer Learning and Multi-Task Framework for Cross-Domain Image Classification..” Ingegneria Sismica Volume 43 Issue 2: 1-16, doi:10.65102/is2026860.

Abstract

As one of the needs of computer vision, image content recognition is the process of identifying objects and scenes in an image through learning visual representations. A fixed ResNet50 backbone and multi-task learning for the contents of images are proposed as the hybrid deep learning model in this paper. The model is also used to regress features and classify images by way of shared representation learning. The Office-Home dataset is employed for the experimental work because it comprises 65 kinds of objects and several visual domains. The classification accuracy and F1 score of the proposed framework are about 74% and 0.73, respectively; thus, good feature learning and domain adaptation have been achieved. Ablation experiments have confirmed that the proposed strategies of data augmentation, depth of backbones and stabilisation during training (such as early stopping and learning rate schedules) are indeed effective. Although the regression branch is less semantically interpretable due to the use of one-hot targets, all the results show that the proposed framework will provide a good and effective basis for tasks requiring the understanding of image content. Based on the above results, we can analyze the strengths and weaknesses of learning about multi-task in real-world applications of computer vision.

Keywords
Image Content Understanding, Computer Vision, Deep Learning, Multi-Task Learning, ResNet50, Image Classification

Related Articles

Qianwen Xiong1, Yuhong Chen1
1Guangzhou University of Chinese Medicine, School of Pharmaceutical Medicine, Guangzhou,Guangdong,China,510006
Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China