Outline

Ingegneria Sismica

Ingegneria Sismica

Research on Sensory Compensation Interaction Model and Multimodal Information Fusion Mechanism in Navigation for Hearing Impaired Drivers

Author(s): Taian Peng1
1School of Computer Science, University of Birmingham, Birmingham B152TT, West Midlands, United Kingdom
Peng, Taian. “Research on Sensory Compensation Interaction Model and Multimodal Information Fusion Mechanism in Navigation for Hearing Impaired Drivers.” Ingegneria Sismica Volume 43 Issue 1: 1-15, doi:10.65102/is2026177.

Abstract

This study examines navigation support for drivers with hearing impairment from the perspective of sensory compensation and multimodal information fusion.Most existing navigation systems depend primarily on voice guidance, which reduces their effectiveness when auditory cues are not directly accessible.Previous studies have considered visual and haptic alternatives, but these methods still show limitations in rapidly changing driving environments, particularly in adaptation, stability, and timely decision support.To address these issues, we propose a navigation framework that integrates compact sensory representation, context-sensitive decision adjustment, and multimodal signal fusion.By organizing input information efficiently and combining cues from different channels, the system is designed to provide more stable and responsive navigation assistance under dynamic road conditions.We further introduce a coordination strategy based on constrained optimization and policy-driven control to maintain consistency among representation, decision, and fusion during navigation. Experiments on multiple datasets show that the proposed framework improves navigation-related performance over baseline methods, including gains in accuracy and response efficiency under the evaluated settings.These results suggest that combining structured sensory representation with context-sensitive decision making and probabilistic fusion can provide more reliable navigation support for hearing-impaired drivers.

Keywords
sensory compensation; multimodal information fusion; navigation systems; hearing-impaired drivers; Counterfactual Navigation Synthesizer

Related Articles

Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China
Ken Wang1, Jinhan Shu2, Kan Yuan1
1School of Digital Media, Shenzhen Polytechnic University, Shenzhen 518055, Guangdong, China
2Postdoctoral Mobile Station of Journalism and communication, Fudan University, Shanghai 200433, Shanghai, China