Outline

Ingegneria Sismica

Ingegneria Sismica

Deep integration of artificial intelligence and big data technologies in the news production process

Author(s): Ning Shuo1,2
1Television School, Communication University of China, Beijing, 010024, China
2College of Liberal Arts & Journalism, Inner Mongolia University, Hohhot, Inner Mongolia, 010021, China
Shuo, Ning. “Deep integration of artificial intelligence and big data technologies in the news production process.” Ingegneria Sismica Volume 43 Issue 1: 1-24, doi:10.65102/is2026249.

Abstract

News text summary generation is an important part of the news production process, which is based on the news text keywords to highly condense the text content and help the news information to be quickly understood and smoothly digested. This paper combines the Htmlparser tool with an improved template-based SST tree method to obtain key news information text in web pages. Aiming at the characteristics of large data volume and more isolated points of news event information, the data metaclustering algorithm under the idea of density clustering is proposed for feature mining of news information text. On this basis, the LDA topic model is used to obtain the topic difference influence degree of information text keywords, the fusion of LSTM model and word2ec model is used to calculate the semantic relevance influence degree, and the two influence degree features are put into the TextRank algorithm to calculate the keyword importance. A generative code summarization model structured by multi-component encoder, encoder and keyword guidance is formed, and the keyword information is used to guide the encoder to generate summaries corresponding to the topics of the original text, so as to transform structured text data into short code summaries. The keyword-guided news generative summarization model generates new word rates between 18.97% and 91.01% in different structural tasks, and the three evaluation indexes of ROUGE-1, ROUGE-2, and ROUGE-L are as high as 46.36%, 29.78%, and 41.49%, respectively. The automatic generation of abstracts with artificial intelligence supported by big data technology realizes the information summarization and framework refinement of news text, and promotes the double improvement of news production quality and efficiency.

Keywords
generative summary model; data metaclustering; news production; artificial intelligence; keyword guidance

Related Articles

Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China
Ken Wang1, Jinhan Shu2, Kan Yuan1
1School of Digital Media, Shenzhen Polytechnic University, Shenzhen 518055, Guangdong, China
2Postdoctoral Mobile Station of Journalism and communication, Fudan University, Shanghai 200433, Shanghai, China