Outline

Ingegneria Sismica

Ingegneria Sismica

Application of Program Code Semantic Understanding Model Based on Transformer Architecture in Automatic Grading of Data Structure Course

Author(s): Mingxing Zhu1, Xin Guo2
1Zhixing College of Hubei University, Wuhan, Hubei, 430011, China
2Zhixing College of Hubei University, wuhan, Hubei, 430011, China
Zhu, Mingxing. and Guo, Xin. “Application of Program Code Semantic Understanding Model Based on Transformer Architecture in Automatic Grading of Data Structure Course.” Ingegneria Sismica Volume 43 Issue 1: 1-19, doi:10.65102/is2026091.

Abstract

In order to solve the problem of “testable results but difficult to describe semantics” in automatic scoring of data structure course, this paper constructs a method for semantic understanding and automatic scoring of program code based on Transformer architecture. In this study, student submitted code, problem constraints, test results and structural features are integrated into the unified processing flow. Through code preprocessing, semantic coding, reference semantic alignment and multidimensional score aggregation, the joint evaluation of program correctness, implementation quality and structural rationality is realized. In the system design, a test set organization mechanism and a scoring feedback link for data structure questions are established, so that the automatic evaluation is no longer limited to input-output comparison, but can further identify the implementation differences in typical tasks such as linked lists, trees, and graphs. The experimental results based on 1184 valid program samples show that the Accuracy of the proposed method reaches 0.907, Macro-F1 is 0.889, QWK is 0.926, and RMSE is reduced to 3.84. The overall performance is better than that of rule scoring and multiple comparison models. The research shows that the introduction of Transformer code semantic modeling into the course evaluation process can effectively improve the accuracy, stability and teaching adaptability of automatic scoring.

Keywords
Transformer; Program code semantic understanding; Automatic scoring; Data Structure Course

Related Articles

Huiqiao Liu1
1Yinchuan University of Energy, Ningxia, 750000, China
Xin Zhao1, Yan Li1, Xiangyang Cao1, Qiushuang Li1, Jianing Zhang1
1State Grid Shandong Electric Power Company Economic and Technological Research Institute ShanDong JiNan 250001, China
Dan Yang1
1School of Marxism, Suzhou Polytechnic University, Suzhou, 215104, China
Liuhang Shen1, Xiangwen Sun1
1Ulster college at Shaanxi University of Science &Technology, Xi’an,710021, Shaanxi, China