In response to the problem that traditional empirical statistical methods are difficult to accurately predict the degree of seismic damage to masonry structures and have a large deviation from actual seismic damage patterns, this paper takes a six story dormitory building with masonry on the bottom frame as the research object, and conducts seismic damage prediction and numerical simulation research. Firstly, a comprehensive modeling strategy is adopted to establish a finite element model of the masonry structure based on ABAQUS. The concrete damage plasticity (CDP) model is selected to describe the material constitutive behavior, and a three line hysteresis restoring force model considering stiffness degradation is introduced to characterize the interlayer mechanical properties; Secondly, the effectiveness of the model was verified through quasi-static experiments. Five amplitude modulated seismic waves were selected for dynamic elastoplastic time history analysis, and the seismic performance of the structure was evaluated based on plastic energy dissipation theory. The local deformation and energy dissipation laws of the wall under different construction measures were compared. Finally, experimental analysis shows that the fusion method of the established mathematical model and finite element simulation can accurately predict the evolution law of seismic damage in masonry structures. The construction of columns is a key measure to improve the seismic performance and collapse prevention ability of masonry structures. The research results can provide theoretical basis for seismic identification and reinforcement of masonry structures.