Outline

Ingegneria Sismica

Ingegneria Sismica

An Intelligent Evaluation Model for English Classroom Interaction Quality Based on Multimodal Data

Author(s): Yang Liu1, Tao Yang2
1Jilin Vocational College of Industry and Technology, Jilin, Jilin, 132000, China
2Zunyi Normal College, Zunyi, Guizhou, 563000, China
Liu, Yang . and Yang, Tao . “An Intelligent Evaluation Model for English Classroom Interaction Quality Based on Multimodal Data.” Ingegneria Sismica Volume 43 Issue 2: 1-20, doi:10.65102/is2026809.

Abstract

In response to the problem of strong subjectivity and insufficient process evidence in the evaluation of interactive quality in English classrooms, this paper constructs a multimodal intelligent evaluation model that integrates video, audio, and classroom transcribed text. Based on 48 real English classes and 1920 interactive segments, establish a five dimensional annotation system for questioning quality, feedback effectiveness, participation breadth, emotional atmosphere, and target language interaction density. The results showed that the intra class correlation coefficient (ICC) was 0.86. The macro average F1 value (Macro-F1) of the proposed model on the test set is 0.803, the mean absolute error (MAE) is 0.298, and the correlation coefficient between classroom level prediction and expert rating is 0.861. The ablation and case analysis show that there are differences in the dependence of different interaction dimensions on text, audio, and visual modalities. The model can also identify clues such as open questioning, waiting time, and participation coverage, providing interpretable basis for teachers to improve classroom interaction.

Keywords
multimodal learning analytics; English classroom interaction; teaching quality evaluation; cross-modal fusion; interpretable artificial intelligence

Related Articles

Qianwen Xiong1, Yuhong Chen1
1Guangzhou University of Chinese Medicine, School of Pharmaceutical Medicine, Guangzhou,Guangdong,China,510006
Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China