Outline

Ingegneria Sismica

Ingegneria Sismica

Research on CNN Transformer modeling method with multi head attention in brain imaging for anxiety disorder recognition

Author(s): Jing Xia1,2, Leilei Li3, Wei Wang4, Wenjing Fu1
1School of Medicine, Hainan Vocational University of Science and Technology, Haikou 571126, Hainan, China
2School of Pharmacy, China Medical University, Shenyang 110122, Liaoning, China
3Shanghai Institute of Materia Medica, Chinese Academy of Sciences, Shanghai 201203, Shanghai, China
4School of Basic Medicine, Xinjiang Medical University, Urumqi 830017, Xinjiang, China
Xia, Jing. et al “Research on CNN Transformer modeling method with multi head attention in brain imaging for anxiety disorder recognition.” Ingegneria Sismica Volume 43 Issue 2: 1-17, doi:10.65102/is2026739.

Abstract

Anxiety disorder is a highly prevalent mental illness, and its current diagnosis mainly relies on symptomatology standards, which can lead to missed diagnosis and misdiagnosis. There is a lack of reliable imaging biomarkers and efficient recognition methods. To solve this problem, this paper proposes a brain image multi head attention CNN Transformer modeling method for anxiety disorder recognition. Firstly, patients with anxiety disorders (GAD and PD) and healthy individuals were selected as the research subjects, and 3.0T magnetic resonance imaging data was collected. After preprocessing, multi-modal features of ALFF, GMV, and FA were extracted and feature maps were constructed; Secondly, design a simplified multi head attention CNN Transformer model that removes the decoder and only optimizes the encoder, combined with Adam optimizer and dropout regularization to improve model performance; Finally, the effectiveness of the model was validated through baseline comparison experiments and ablation experiments. The experimental results show that the proposed model performs stably on three datasets, with accuracy rates of 86.0% and 86.9% in datasets 2 and 3, respectively, significantly better than the baseline algorithm; The ablation experiment showed that after removing CNN or multi head attention modules, the maximum decrease in accuracy reached 13.3%, and each module is crucial to the performance of the model. Research has shown that the proposed model can effectively capture anxiety disorder features in brain imaging, with good effectiveness and generalization, and can provide reliable technical support for early diagnosis of anxiety disorders.

Keywords
Anxiety disorder; Multi head attention; Brain imaging; Magnetic resonance imaging; Transformer; CNN

Related Articles

Huiqiao Liu1
1Yinchuan University of Energy, Ningxia, 750000, China
Xin Zhao1, Yan Li1, Xiangyang Cao1, Qiushuang Li1, Jianing Zhang1
1State Grid Shandong Electric Power Company Economic and Technological Research Institute ShanDong JiNan 250001, China
Dan Yang1
1School of Marxism, Suzhou Polytechnic University, Suzhou, 215104, China
Liuhang Shen1, Xiangwen Sun1
1Ulster college at Shaanxi University of Science &Technology, Xi’an,710021, Shaanxi, China