Short Text Feature Extension and Classification Method Based on Semantic Embedding of Tags and Graph Convolution Network

Zhang Ling; Li Rong-zhen; Zheng Su

doi:10.12052/gdutxb.220132

English Version Journal Login

您当前的位置：

首页 >

文章列表页 >

Short Text Feature Extension and Classification Method Based on Semantic Embedding of Tags and Graph Convolution Network

更新时间：2026-05-27

- Short Text Feature Extension and Classification Method Based on Semantic Embedding of Tags and Graph Convolution Network
- Vol. 41, Issue 1, Pages: 69-78(2024)
- 作者机构：
  
  1. 广东工业大学计算机学院,广东,广州,510006
  2. 宁夏大学教育学院,宁夏,银川,750001
- 作者简介：
- 基金信息：
- DOI：10.12052/gdutxb.220132
  CLC： TP391
- Online First：25 January 2024，
  
  Published：2024
- 稿件说明：
移动端阅览
张灵, 李荣臻, 郑苏. 融合标签语义嵌入和图卷积的短文本特征扩展及分类方法[J]. 广东工业大学学报, 2024, 41(1): 69-78.

Zhang Ling, Li Rong-zhen, Zheng Su. Short Text Feature Extension and Classification Method Based on Semantic Embedding of Tags and Graph Convolution Network[J]. 2024, 41(1): 69-78.
张灵, 李荣臻, 郑苏. 融合标签语义嵌入和图卷积的短文本特征扩展及分类方法[J]. 广东工业大学学报, 2024, 41(1): 69-78. DOI： 10.12052/gdutxb.220132.

Zhang Ling, Li Rong-zhen, Zheng Su. Short Text Feature Extension and Classification Method Based on Semantic Embedding of Tags and Graph Convolution Network[J]. 2024, 41(1): 69-78. DOI： 10.12052/gdutxb.220132.

摘要

针对短文本长度过短、关键词偏少和标签信息利用不足造成的分类过程中面临特征稀疏和语义不明确的问题，提出了融合标签语义嵌入的图卷积网络模型。首先，在传统的术语频率和逆文档频率算法基础上，提出了融合单词所属文本的类间、类内分布关系的全局词频提取算法。其次，利用融合标签嵌入的方法，将每条训练文本与相对应的标签引入到同一个特征空间内，通过筛选聚合提取更能突显文本类别的近义词嵌入，作为文本图的文档节点的嵌入表示。最后，将文本图输入到图卷积神经网络学习后，获得的特征与预训练模型提取文本上下文的特征相融合，提升短文本的分类质量以及整个模型的泛化能力，在4个短文本数据集MR、web_snippets、R8和R52上对本文模型和14个基线算法进行了对比实验，结果表明本文提出的模型相比于对比模型具有更优的结果，在识别精度、召回率以及

值上有着更好的表现。

Abstract

In short text classification

too short text length

fewer keywords and underutilization of the label information leads to the severe problems of sparse features and ambiguous semantics

which can affect the performance of short text classification. Agraph convolution network model based on tag semantic embedding is proposed for the problem. Firstly

according to TF/IDF

a new word frequency method is proposed

which comprehensively considers the inter-class and intra-class distribution of words in the global corpus. Then

through By label embedding method

each training

text with the corresponding label is mapped into one feature space in the text graph. After filtering and aggregation in one feature space

synonyms embedded of label information can highlight the category representation. Finally

the text graph is input into the graph convolution neural network to learn new feature. Both the learned new feature Both the learned new feature and the features from the pre-training model can improve the classification accuracy of short texts and the generalization ability of the whole model. We choose four short text datasets such as MR

web_snippets

R8 and R52

to evaluate the performance of our proposed algorithm and fourteen benchmark models. The experimental results show that the proposed model in this paper is superior to others in classification accuracy

recall ratio and

-score.

关键词

Keywords

references

TURKOGLU M, HANBAY D, SENGUR A. Multi-model L- STM-based convolutional neural networks for detection of apple diseases and pests [J]. Journal of Ambient Intelligence and Humanized Computing, 2022, 13(1): 3335-3345.

CANIZO M, TRIGUERO I, CONDE A, et al . Multi-head CNN-RNN for multi-time series anomaly detection: an ind- ustrial case study [J ] . Neurocomputing, 2019, 363: 246-260.

XU K, HU W, LESKOVEC J, et al. How powerful are graph neural networks?[C]//International Conference on Learning Representation. New Orleans: ICLR, 2019: 1-17.

KIPF, WELLING M, THOMAS N. Semi-supervisedclassification with graph convolutional networks[C]//International Conference on Learning Representations. Toulon, France: ICLR, 2017: 1-14.

YAO L, MAO C S, LUO Y. Graph convolutional networks for text classification[C]//33rd AAAI Conference on Artificial Intelligence. Honolulu: AAAI, 2019: 7370-7377.

DRASKO R, BOZO K. Review spam detection using mac- hine learning[C]//23th International Scientific-Professional Conference on Information Technology. New Delhi, India: IT, 2018: 1-4.

BAKSHI R K, KAUR N, KAUR R, et al. Opinion mining and sentiment analysis[C]//Computing for Sustainable Glo-bal Development. New Delhi, India: INDIACom, 2016: 452-455.

BOUAZIZ A, DARTIGUES-PALLEZ C, PEREIRA C D C, et al . Short text classification using semantic random forest [J ] . Springer International Publishing, 2014, 8646: 288-299.

FANG C, LI B, HAN P. Semi-supervised microblog text sentiment classification based on global feature graph [J]. Journal of Signal Processing, 2021, 37(6): 1066-1074.

CUI W Q, DU J P, KOU F F, et al . The social and conceptual semantic extended search method for microblog short text [J ] . Journal of Computer Reasearch and Development, 2018, 55(8): 1641-1652.

WANG G, LI C, WANG W, et al. Joint embedding of words and labels for text classification[C]//Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. New Orleans: NAACL-HLT, 2018: 461-469.

VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[C]//Conference and Workshop on Neural Information Processing Systems. Long Beach, California, U- SA: ACM, 2017: 6000-6010.

张万杰. 引入标签语义信息的多标签文本分类[J]. 计算机应用, 2021, 8: 1672-9528.

JI F, YANG J L, ZHANG Q, et al. GraphFlow: a new graph convolutional network based on parallel flows [C]//Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing. Barcelona: ICASSP, 2020: 3332-3336.

ZHENG C, DONG C Y, HUANG X Y. Short text classification method based on BTM graph convolution network [J]. Computer Engineering and Application, 2021, 57(4): 155-160.

辛媛. 基于图神经网络的单标签文本分类[D]. 合肥: 中国科技技术大学, 2021, 1-61.

SHEN Y G, JIA Y Q. Text categorization method based on word co-occurrence and graph convolution [J]. Computer Engineering and Application, 2021, 57(11): 173-178.

ZHENG C, CHEN J, DONG C Y. Deep neural network combined with graph convolution for text classification [J]. Computer Engineering and Application, 2022, 58(7): 206-212.

LIU X, YOU X, ZHANG X, et al. Tensor graph convolutional networks for text classification[C]//Proceedings of the AAAI Conference on Artificial Intelligence. New York, US-A: AAAI, 2020: 8409-8416.

WU F, ZHANG T, SOUZA A, et al. Simplifying graph convolutional networks[C]//International Conference on Machine Learning. Long Beach, CA, USA: ICML, 2019: 1-14.

ZHANG Y F, YU X L, CUI ZY, et al. Every document owns its structure: inductive text classification via graph neural networks[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Seattle, Washington, United States: ACL, 2020: 334-339.

DING K Z, WANG J L, LI J D, et al. Be more with less: hypergraph attention networks for inductive text classification [C]//The 2020 Conference on Empirical Methods in Natural Language Processing. Online: EMNLP, 2020: 4927-4936.

LIN Y X, MENG Y X, SUN X F, et al. BertGCN: transductive text classification by combining GCN an BERT[C]//Annual Meeting of the Association for Computational Linguistics. Bangkok, Thailand: ACL-IJCNLP, 2021: 1456-1462.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Research on Foreign Object Detection in Power Transmission Lines Based on the AAGV-YOLOX Model

Ground Deformation Monitoring and Influencing Factors Analysis in Fuzhou City Based on PSI Technology

Modeling of 3D NAND Memory Cells with Taper Angle and Programming Strategy Optimization

An Optimal Operation Strategy for Community Microgrid Alliances Considering Power Exchange under Multi-package Shared Energy Storage Model

Efficient Temporal Modeling for RGB-T Tracking

Related Author

No data

Related Institution

No data

AI问答

⁰