An Attention Text Summarization Model Based on Syntactic Structure Fusion

Teng Shao-hua; Dong Pu; Zhang Wei

doi:10.12052/gdutxb.200173

English Version Journal Login

您当前的位置：

首页 >

文章列表页 >

An Attention Text Summarization Model Based on Syntactic Structure Fusion

更新时间：2026-05-27

- An Attention Text Summarization Model Based on Syntactic Structure Fusion
- Vol. 38, Issue 3, Pages: 1-8(2021)
- 作者机构：
  
  广东工业大学计算机学院,广东,广州,510006
- 作者简介：
- 基金信息：
- DOI：10.12052/gdutxb.200173
  CLC： TP391
- Online First：10 May 2021，
  
  Published：2021
- 稿件说明：
移动端阅览
滕少华, 董谱, 张巍. 融合语义结构的注意力文本摘要模型[J]. 广东工业大学学报, 2021, 38(3): 1-8.

Teng Shao-hua, Dong Pu, Zhang Wei. An Attention Text Summarization Model Based on Syntactic Structure Fusion[J]. 2021, 38(3): 1-8.
滕少华, 董谱, 张巍. 融合语义结构的注意力文本摘要模型[J]. 广东工业大学学报, 2021, 38(3): 1-8. DOI： 10.12052/gdutxb.200173.

Teng Shao-hua, Dong Pu, Zhang Wei. An Attention Text Summarization Model Based on Syntactic Structure Fusion[J]. 2021, 38(3): 1-8. DOI： 10.12052/gdutxb.200173.

摘要

传统基于序列的文本摘要生成模型未考虑词的上下文语义信息

导致生成的文本摘要准确性不高

也不符合人类的语言习惯。本文提出了一种基于文本语义结构的文本摘要生成模型(Structure Based Attention Sequence to Sequence Model

SBA)

结合注意力机制的序列到序列生成模型

引入文本的句法结构信息

使得注意力结构得到的上下文向量同时包含文本语义信息与句法结构信息

获得生成的文本摘要。最后

基于Gigaword数据集的实验结果表明

提出的方法能有效地提高生成摘要的准确性以及可读性。

Abstract

The traditional text summarization generation model based on sequence does not consider the context semantic information of words

which leads to the low accuracy of the generated text summary and does not conform to the human language habits. In view of this inadequacy

a structure-based attention sequence to sequence model (SBA) is proposed

which combines the sequence to sequence generation model of attention mechanism and introduces the syntactic structure information of the text

so that the context vector obtained by the attention structure contains both the semantic information and the syntactic structure information of the text

so as to obtain the generated text abstract. The experimental results based on Gigaword dataset show that the proposed method can effectively improve the accuracy and readability of the generated summary.

关键词

Keywords

references

GAMBHIR M, GUPTA V. Recent automatic text summarization techniques: a survey [J]. Artificial Intelligence Review, 2017, 47(1): 1-66.

SUTSKEVER I, VINYALS O, LE Q V. Sequence to sequence learning with neural networks[C]//Advances in Neural Information Processing Systems. Montereal: MIT Press, 2014: 3104-3112.

ELMAN J L. Finding structure in time [J]. Cognitive Science, 1990, 14(2): 179-211.

HOCHREITER S, SCHMIDHUBER J. Long short-term memory [J]. Neural Computation, 1997, 9(8): 1735-1780.

RUSH A M, CHOPRA S, WESTON J. A neural attention model for abstractive sentence summarization[C]//Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. Lisbon: ACL, 2015: 379-389.

CHOPRA S, AULI M, RUSH A M. Abstractive sentence summarization with attentive recurrent neural networks[C]//Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. San Diego: ACL, 2016: 93-98.

NALLAPATI R, ZHOU B, DOS SANTOS C, et al. Abstractive text summarization using sequence-to-sequence RNNs and beyond[C]//Proceedings of the 20th SIGNLL Conference on Computational Natural Language Learning. Berlin: CoNLL, 2016: 280-290.

GULCEHRE C, AHN S, NALLAPATI R, et al. Pointing the unknown words[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. Berlin: ACL, 2016: 140-149.

GU J, LU Z, LI H, et al. Incorporating copying mechanism in sequence-to-sequence learning[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. Berlin: ACL, 2016: 1631-1640.

SEE A, LIU P J, MANNING C D. Get to the point: summarization with pointer-generator networks[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics. Vancouver: ACL, 2017: 1073-1083.

LIU L, LU Y, YANG M, et al. Generative adversarial network for abstractive text summarization[C]//Proceedings of the AAAI Conference on Artificial Intelligence. San Francisco: AAAI, 2017: 8109-8110.

ZHANG M, ZENG B Q, HAN X L, et al . DAPC: dual attention and pointer-coverage network based summarization model [J ] . Computer Engineering and Applications, 2020, 56(8): 149-157.

DANG H S, TAO Y F, ZHANG X D. Abstractive summarization model based on mixture attention and reinforcement learning [J]. Computer Engineering and Applications, 2020, 56(1): 185-190.

LI J, XIONG D, TU Z, et al. Modeling source syntax for neural machine translation[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics. Vanconver: ACL, 2017: 688-697.

CAO Z, WEI F, LI W, et al. Faithful to the original: fact aware neural abstractive summarization[C]//Proceedings of the AAAI Conference on Artificial Intelligence. New Orleans: AAAI, 2018: 4781-4791.

TAN Y X, TENG S H. Combined Weighting Method for Short Text Features [J]. Journal of Guangdong University of Technology, 2020, 37(5): 51-61.

CHUNG J, GULCEHRE C, CHO K, et al. Empirical evaluation of gated recurrent neural networks on sequence modeling[C]//Advances in Neural Information Processing Systems. Montereal: MIT Press, 2014: 1-9.

LIU R, HU J, WEI W, et al. Structural embedding of syntactic trees for machine comprehension[C]//Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Copenhagen: ACL, 2017: 815-824.

GOODFELLOW I, BENGIO Y, COURVILLE A. Deep learning[M]. Cambridge: MIT Press, 2016: 55-60.

TAN J, WAN X, XIAO J. Abstractive document summarization with a graph-based attentional neural model[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics. Voncouver: ACL, 2017: 1171-1181.

LIN C Y. Rouge: a package for automatic evaluation of summaries[C]//Text Summarization Branches Out. Barcelona: ACL, 2004: 74-81.

KINGMA D P, BA J A. A method for stochastic optimization[C]//Proceedings of the 3rd International Conference for Learning Representations. San Diego: ICLR, 2015: 1-15.

LI P, LAM W, BING L, et al. Deep recurrent generative decoder for abstractive text summarization[C]//Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Copenhagen: ACL, 2017: 2091-2100.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Unsupervised GAN Multi-focus Image Fusion Based on Attention Mechanism

Point Cloud Module Based on Hidden Features

A Multi-Portrait Semantic Segmentation Method Based on Semantic Fusion Features

An Optimal Operation Strategy for Community Microgrid Alliances Considering Power Exchange under Multi-package Shared Energy Storage Model

Robust Design for Artificial Noise-assisted UAV Terahertz Secure Communication

Related Author

Li Weitong

Jiang Yunfeng

Tan Zhe

Huang Guoheng

Chen Jiahong

Gao Xiang

Li Guangping

Zou Shuhang

Related Institution

School of Information Engineering, Guangdong University of Technology

School of Computer Science and Technology, Guangdong University of Technology

School of Automation, Guangdong University of Technology

School of Electronics and Information Engineering, Guangdong Polytechnic Normal University

School of Electronics and Information, Guangdong Polytechnic Normal University

AI问答

⁰