Outline

Ingegneria Sismica

Ingegneria Sismica

CER: Learning Causally Sufficient Evidence Sets for Verifiable and Trustworthy RAG

Author(s): Jizhang Tan1, Yonghui Xu2, Lizhen Cui3
1School of Software, Shandong University, Jinan, 25000,Shandong, China
2Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR), Shandong University, Jinan, 25000, Shandong, China
3School of Software, Shandong University, Jinan, 25000, Shandong, China
Tan, Jizhang., Xu, Yonghui ., and Cui, Lizhen. “CER: Learning Causally Sufficient Evidence Sets for Verifiable and Trustworthy RAG.” Ingegneria Sismica Volume 43 Issue 1: 1-22, doi:10.65102/is2026255.

Abstract

Aiming at the problem that evidence selection in retrieval enhancement generation focuses on semantic relevance, and it is difficult to ensure causal necessity and minimum sufficiency, a retrieval enhancement generation method based on verifiable causal sufficient evidence set was proposed. Method A counterfactual delete-replace intervention is used to construct an evidence-level supervision signal. A pre-trained language model causal re-ranking, R-GCN evidence complementary modeling, quality proxy function calibration, and minimum sufficient set search are combined to jointly optimize the answer quality, evidence size, and reasoning cost. Experiments on HotpotQA, HOVER, QASPER and ALCE datasets show that the proposed method achieves F1 of 67.1 on HotpotQA and 82.3 on HOVER, with an average evidence size reduction of 18%-22%. The context overhead is reduced by up to 60%, and it maintains better robustness under the condition of conflict evidence and near-repeated interference. The results show that the proposed method can effectively improve the verifiability, compactness and stability of the retrieval enhancement generation system.

Keywords
Retrieval enhancement generation; Counterfactual learning; Evidence graph modeling; Verifiable generation

Related Articles

Qianwen Xiong1, Yuhong Chen1
1Guangzhou University of Chinese Medicine, School of Pharmaceutical Medicine, Guangzhou,Guangdong,China,510006
Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China