Outline

Ingegneria Sismica

Ingegneria Sismica

R&D and Promotion Path of Multi-source Data Fusion Technology in Smart Classroom Construction

Author(s): Bei Zhang1, Lin Zhang2
1College of Teacher Education, Xingtai University, Xingtai, Hebei, 054000, China
2Research and Development Center, Hebei Institute of Machinery & Electricity, Xingtai, Hebei, 054000, China
Zhang, Bei . and Zhang, Lin. “R&D and Promotion Path of Multi-source Data Fusion Technology in Smart Classroom Construction.” Ingegneria Sismica Volume 43 Issue 1: 1-19, doi:10.65102/is2026051.

Abstract

In this paper, we propose a learning input assessment model based on multi-source data fusion, which analyzes students’ expression features with VGG16 network, acquires mouse track data corresponding to students’ expressions based on deep neural network, and then deeply fuses students’ log data and interaction data based on the data conversion algorithm in the event window. The model is utilized to establish a smart classroom, based on which the multidimensional learning characteristics of 50 students are studied, thereby promoting the application of multi-source data fusion technology in the education sector. The multi-source data fusion model can effectively recognize the emotional changes of students in the smart classroom, and the accuracy of multi-emotion recognition is more than 95%. In the smart classroom, the students’ mouse browsing trajectories focused on the web pages of “Teaching and Learning” and “Teaching Tools and Resources”, with a total click frequency of 1959 and 2005, respectively. Based on the above characteristics, the model classified the 50 students into five categories: focused students, persistent students, persistent students, occasional students and abandoned students, and the average learning input values of each category of students were 4.55, 3.57, 2.48, 1.48, and 0.54, respectively. The construction of the smart classroom is helpful for the wide dissemination of the model.

Keywords
Multi-source data fusion; Learning engagement assessment model; VGG16 network; Deep neural network; Smart classroom

Related Articles

Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China
Ken Wang1, Jinhan Shu2, Kan Yuan1
1School of Digital Media, Shenzhen Polytechnic University, Shenzhen 518055, Guangdong, China
2Postdoctoral Mobile Station of Journalism and communication, Fudan University, Shanghai 200433, Shanghai, China