Outline

Ingegneria Sismica

Ingegneria Sismica

Quantitative Analysis and Optimization of Film Narrative Rhythm through Deep Learning with Spatiotemporal Feature Fusion

Author(s): Zhiyuan Tian1
1Communication University of Zhejiang, Hangzhou, 318000, Zhejiang, China
Tian, Zhiyuan . “Quantitative Analysis and Optimization of Film Narrative Rhythm through Deep Learning with Spatiotemporal Feature Fusion.” Ingegneria Sismica Volume 43 Issue 2: 1-17, doi:10.65102/is2026806.

Abstract

All quantification and optimization of film-narration-rhythm have relied on the intuitive judgment of subject-editor without a firm mathematical basis in practice. At present, these traditional approaches cannot distinguish between minor combinations of spatial visual composition and long-term temporal narrative pacing. To overcome these deficiencies, this paper presents a new Deep Learning framework combining Spatiotemporal feature fusion (STFF) to intelligently quantify and optimise cinema rhythm. A parallel extraction network has been introduced to the architecture of this study; specifically, there is a ResNet-50-based spatial feature-extraction module and a three-dimensional convolutional networks (C3D) used for time-dependent movements and behaviours analysis. A custom Spatiotemporal Attention Module (STAM) is introduced to adaptively re-calibrate feature weights across both dimensions. Based on the curated annotation data of 12,500 films from a specific collection, the proposed STFF model obtained a Rhythm Concordance Index (RCI) of 94.6% and an MAE value of 0.082 compared to the baseline methods; these were significantly higher than anticipated outcomes. Ablation studies have confirmed that the two streams combined work together. A scalable, quantifiable and clinically-relevant model of automatic film editing and rhythm adjustment is introduced in this paper.

Keywords
Film Narrative Rhythm; Spatiotemporal Feature Fusion; Deep Learning; Quantitative Analysis; Video Processing; Attention Mechanism

Related Articles

Huiqiao Liu1
1Yinchuan University of Energy, Ningxia, 750000, China
Xin Zhao1, Yan Li1, Xiangyang Cao1, Qiushuang Li1, Jianing Zhang1
1State Grid Shandong Electric Power Company Economic and Technological Research Institute ShanDong JiNan 250001, China
Dan Yang1
1School of Marxism, Suzhou Polytechnic University, Suzhou, 215104, China
Liuhang Shen1, Xiangwen Sun1
1Ulster college at Shaanxi University of Science &Technology, Xi’an,710021, Shaanxi, China