Outline

Ingegneria Sismica

Ingegneria Sismica

Quantitative Analysis and Optimization of Film Narrative Rhythm through Deep Learning with Spatiotemporal Feature Fusion

Author(s): Zhiyuan Tian1
1Communication University of Zhejiang, Hangzhou, 318000, Zhejiang, China
Tian, Zhiyuan . “Quantitative Analysis and Optimization of Film Narrative Rhythm through Deep Learning with Spatiotemporal Feature Fusion.” Ingegneria Sismica Volume 43 Issue 2: 1-17, doi:10.65102/is2026806.

Abstract

All quantification and optimization of film-narration-rhythm have relied on the intuitive judgment of subject-editor without a firm mathematical basis in practice. At present, these traditional approaches cannot distinguish between minor combinations of spatial visual composition and long-term temporal narrative pacing. To overcome these deficiencies, this paper presents a new Deep Learning framework combining Spatiotemporal feature fusion (STFF) to intelligently quantify and optimise cinema rhythm. A parallel extraction network has been introduced to the architecture of this study; specifically, there is a ResNet-50-based spatial feature-extraction module and a three-dimensional convolutional networks (C3D) used for time-dependent movements and behaviours analysis. A custom Spatiotemporal Attention Module (STAM) is introduced to adaptively re-calibrate feature weights across both dimensions. Based on the curated annotation data of 12,500 films from a specific collection, the proposed STFF model obtained a Rhythm Concordance Index (RCI) of 94.6% and an MAE value of 0.082 compared to the baseline methods; these were significantly higher than anticipated outcomes. Ablation studies have confirmed that the two streams combined work together. A scalable, quantifiable and clinically-relevant model of automatic film editing and rhythm adjustment is introduced in this paper.

Keywords
Film Narrative Rhythm; Spatiotemporal Feature Fusion; Deep Learning; Quantitative Analysis; Video Processing; Attention Mechanism

Related Articles

Qianwen Xiong1, Yuhong Chen1
1Guangzhou University of Chinese Medicine, School of Pharmaceutical Medicine, Guangzhou,Guangdong,China,510006
Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China