A Knowledge Representation Model Based on Bi-Objective Alternate Optimization Under Probability

Zhang Xin; Wang Zhen-you

doi:10.12052/gdutxb.210062

English Version Journal Login

您当前的位置：

首页 >

文章列表页 >

A Knowledge Representation Model Based on Bi-Objective Alternate Optimization Under Probability

更新时间：2026-05-27

- A Knowledge Representation Model Based on Bi-Objective Alternate Optimization Under Probability
- Vol. 39, Issue 4, Pages: 24-31(2022)
- 作者机构：
  
  广东工业大学数学与统计学院,广东,广州,510520
- 作者简介：
- 基金信息：
- DOI：10.12052/gdutxb.210062
  CLC： TP3
- Online First：10 July 2022，
  
  Published：2022
- 稿件说明：
移动端阅览
张欣, 王振友. 概率条件下基于双目标交替优化的知识表示模型[J]. 广东工业大学学报, 2022, 39(4): 24-31.

Zhang Xin, Wang Zhen-you. A Knowledge Representation Model Based on Bi-Objective Alternate Optimization Under Probability[J]. 2022, 39(4): 24-31.
张欣, 王振友. 概率条件下基于双目标交替优化的知识表示模型[J]. 广东工业大学学报, 2022, 39(4): 24-31. DOI： 10.12052/gdutxb.210062.

Zhang Xin, Wang Zhen-you. A Knowledge Representation Model Based on Bi-Objective Alternate Optimization Under Probability[J]. 2022, 39(4): 24-31. DOI： 10.12052/gdutxb.210062.

摘要

针对TransD模型参数多和实体两种表示间没有关联的问题，提出一种改进的知识表示模型PTransD。通过减少实体投影数

并对实体进行聚类来减少参数量，同时利用K-L(Kullback-Leibler)散度限制实体投影和对应实体类，使其概率分布相同。在模型训练时，对三元组损失和K-L损失交替优化，从类间距大的实体类中替换实体，提高负例质量。最后，在知识图谱数据集上进行三元组分类和链接预测实验。结果表明，该模型的性能在各项指标上均有明显提高，可以应用于知识图谱的完善和推理等。

Abstract

Aiming at the problem that the TransD model has many parameters and the two representations of entities are not related

an improved knowledge representation model PTransD is proposed

which reduces the number of parameters by reducing the number of entity projections and clustering entities

while using K-L (Kullback-Leibler ) The divergence limits the entity projection to the same probability distribution as the corresponding entity class. During model training

the triple loss and K-L loss are alternately optimized

and the entities in the classes with large spacing between the entities are replaced to improve the quality of negative examples. Finally

based on the experimental results of triple classification and link prediction on the knowledge graph data set

the performance has been significantly improved in various indicators. It can be applied to the perfection and reasoning of knowledge map.

关键词

Keywords

references

LENAT D B, PRAKASH M, SHEPHERD M. CYC: using common sense knowledge to overcome brittleness and knowledge acquisition bottlenecks [J]. AI Magazine, 1985, 6(4): 65.

MILLER G A. WordNet [J]. Communications of the ACM, 1995, 38(11): 39-41.

BOLLACKER K, COOK R, TUFTS P. Freebase: ashared database of structured general human knowledge[C]//Proceedings of the Twenty-Second AAAI Conference on Artificial Intelligence. Vancouver: AAAI Press, 2007: 1962-1963.

HUANG X, ZHANG J, LI D, et al. Knowledge graph embedding based question answering [C]//Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining. New York: ACM, 2019: 105-113.

DAI Y, WANG S, XIONG N N, et al . A survey on knowledge graph embedding: approaches, applications and benchmarks [J ] . Electronics, 2020, 9(5): 750.

MIKOLOV T, SUTSKEVER I, CHEN K, et al . Distributed representations of words and phrases and their compositionality [J ] . Advances in Neural Information Processing Systems, 2013, 26: 3111-3119.

BORDES A, USUNIER N, GARCIA-DURAN A, et al. Translating embeddings for modeling multi-relational data[C]// Proceedings of the 26th International Conference on Neural Information Processing Systems. Lake Tahoe: NIPS, 2013: 2787-2795.

LIN Y, LIU Z, SUN M, et al. Learning entity and relation embeddings for knowledge graph completion[C]//Proceedings of the AAAI Conference on Artificial Intelligence. Austin: AAAI Press, 2015: 2181-2187.

JI G, HE S, XU L, et al. Knowledge graph embedding via dynamic mapping matrix[C] //Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing. Beijing: ACL, 2015: 687-696.

WANG H, ZHANG F, ZHAO M, et al. Multi-task feature learning for knowledge graph enhanced recommendation[C]//Proceedings of the 2019 World Wide Web Conference. San Francisco: ACM, 2019: 2000-2010.

WANG Z, ZHANG J, FENG J, et al. Knowledge graph embedding by translating on hyperplanes[C] //In Proceedings of the Twenty-eighth AAAI Conference on Artificial Intelligence. Québec City: AAAI Press, 2014: 1112–1119.

DO K, TRAN T, VENKATESH S. Knowledge graph embedding with multiple relation projections[C]// 2018 24th International Conference on Pattern Recognition. Beijing: IEEE, 2018: 332-337.

ZHU Q, ZHOU X, TAN J, et al. Learning knowledge graph embeddings via generalized hyperplanes[C] //Proceedings of the 18th International Conference on Computational Science. Wuxi: Springer, 2018: 624-638.

BORDES A, GLOROT X, WESTON J, et al. Joint learning of words and meaning representations for open-text semantic parsing[C]// Proceedings of the Fifteenth International Conference on Artificial Intelligence and Statistics. La Palma: PMLR, 2012: 127-135.

BORDES A, WESTON J, COLLOBERT R, et al. Learning structured embeddings of knowledge bases[C]//In Proceedings of the Twenty-eighth AAAI Conference on Artificial Intelligence. San Francisco: AAAI Press, 2011: 301–306.

BORDES A, GLOROT X, WESTON J, et al . A semantic matching energy function for learning with multi-relational data [J ] . Machine Learning, 2014, 94(2): 233-259.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Research on the ET-FSUIE Relation Extraction Model for Transformer Defect Graph Construction

Extension of Knowledge Graph and its Intelligent Extension Library

Multi-Scale Contrastive Embedding Enhanced Adaptive Intrusion Detection Model

Research on Foreign Object Detection in Power Transmission Lines Based on the AAGV-YOLOX Model

The Cross-twin Physics-informed Neural Network for Wave Equations with Conserved Quantities

Related Author

Xie Guobo

Liu Hanlin

Lin Zhiyi

Ye Zhenhao

Li Si

Wang Pei-zhuang

Zeng Fan-hui

Sun Hui

Related Institution

School of Computer Science and Technology, Guangdong University of Technology

Shenzhen Power supply Co., Ltd.

Institute of Intelligence Engineering and Mathematics, Liaoning Technical University

College of Science, Liaoning Technical University

Institute of Extenics and Innovation Methods, Guangdong University of Technology

AI问答

⁰