Outline

Ingegneria Sismica

Ingegneria Sismica

A Research of Classroom Behaviour Dissection and Individualized Teaching Interferences for University Students on Basis of Multimodal Deep Learning

Author(s): Yanting Chang1
1School of Marxism, North Henan Medical University, Xinxiang 453003, Henan, China
Chang, Yanting. “A Research of Classroom Behaviour Dissection and Individualized Teaching Interferences for University Students on Basis of Multimodal Deep Learning.” Ingegneria Sismica Volume 43 Issue 2: 1-19, doi:10.65102/is2026759.

Abstract

For solving the separation problem among student behavior recognition, engagement evaluation and teaching intervention in university classrooms, this article puts forward a method of classroom behavior analysis and individualized teaching intervention which is based on multimodal deep learning. By integrating classroom video, audio, pose sequences, and instructional contextual information, we establish a unified multimodal data organization framework and design the Behavior-State-Intervention Progressive Coupling Network (BSIC-Net), introducing targeted optimizations in three key aspects: reliability-weighted fusion, state-coupled modeling, and intervention prioritization.Based on a cross-domain experimental protocol, we conducted validation of behavior recognition, engagement state estimation, and intervention prioritization on the SCBD, SAV, OUC-CGE, CMOSE, and DIPSER datasets.The results show that the proposed method achieves core metrics of 87.8%, 85.9%, 81.7%, 84.8%, and 80.6% across the five datasets, respectively, with an average performance 3.52 percentage points better than the strongest baseline, and an ECE reduced to 0.043.In the intervention sequencing experiments, the model achieved a 13.0% recovery in engagement by the sixth round for the high-risk student group, representing a 3.6 percentage point improvement over empirical strategies. The ablation experiment outcomes indicate that reliability weight assignment, the state connecting layer, and the intervention sorting head directly make contributions to the main task accuracy degree, state distinguishing stability, and sorting quality, in respective order. This study demonstrates that multimodal classroom analysis can be further advanced from behavior recognition to decision support for instructional responses, providing a practical technical pathway for real-time intervention and refined instructional management in university classrooms.

Keywords
Multimodal deep learning; Classroom behavior analysis; Engagement state estimation; Personalized instructional intervention; Cross-domain validation

Related Articles

Huiqiao Liu1
1Yinchuan University of Energy, Ningxia, 750000, China
Xin Zhao1, Yan Li1, Xiangyang Cao1, Qiushuang Li1, Jianing Zhang1
1State Grid Shandong Electric Power Company Economic and Technological Research Institute ShanDong JiNan 250001, China
Dan Yang1
1School of Marxism, Suzhou Polytechnic University, Suzhou, 215104, China
Liuhang Shen1, Xiangwen Sun1
1Ulster college at Shaanxi University of Science &Technology, Xi’an,710021, Shaanxi, China