Outline

Ingegneria Sismica

Ingegneria Sismica

Visual Symbol Construction in Generative AI Short Videos and the Mechanisms of User Attention Capture: Evidence from an Eye-Tracking Experiment

Author(s): Caiwen Zhao1, Xiaoyi Peng1
1School of Media and Arts, Wuhan Qingchuan University 050306T, Hubei, China
Zhao, Caiwen. and Peng, Xiaoyi. “Visual Symbol Construction in Generative AI Short Videos and the Mechanisms of User Attention Capture: Evidence from an Eye-Tracking Experiment.” Ingegneria Sismica Volume 43 Issue 2: 1-27, doi:10.65102/is2026780.

Abstract

Generative AI has become an ordinary production means of vertical short videos, but it is difficult to judge the effect on users from platform log data only. Does the creation of visual symbols help attract users’ attention more quickly? How are gaze patterns distributed among different Dynamic Areas of Interest (DAOs); Under what circumstances do generated Symbols facilitate perception over inspection? Nine-six short video user groups, age ranging from 18 to 35 years old. The stimulus pool contained 72 clips balanced by production mode, including fully AI-generated, hybrid AI-assisted and human-made videos. Each person saw 18 video clips in random order. Following gaze quality control, there remained 1,641 participants’ videos. Dynamic AOIs are annotated with contents such as faces/characters, objects’ movements, text labels, motion boundaries, call-to-action areas, etc. Time to the first fixational eye movement, symbolic duration reaction, refixation rate, re-entry probability, transition uncertainty, pupillary dilatation, identification corrects, continuous motivation levels for individuals.

Keywords
Generative AI; Short Video; Visual Symbol; Eye Tracking; Attention Capture.

Related Articles

Qianwen Xiong1, Yuhong Chen1
1Guangzhou University of Chinese Medicine, School of Pharmaceutical Medicine, Guangzhou,Guangdong,China,510006
Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China