广东工业大学 数学与统计学院,广东,广州,510520
张欣(1998–),女,硕士研究生,主要研究方向为数据分析、算法设计与分析
王振友(1979–),男,教授,博士,主要研究方向为医学影像学、最优化理论及应用、数值计算等,E-mail:zywang@gdut.edu.cn
网络首发:2022-07-10,
纸质出版:2022
移动端阅览
张欣, 王振友. 概率条件下基于双目标交替优化的知识表示模型[J]. 广东工业大学学报, 2022, 39(4): 24-31.
Zhang Xin, Wang Zhen-you. A Knowledge Representation Model Based on Bi-Objective Alternate Optimization Under Probability[J]. 2022, 39(4): 24-31.
张欣, 王振友. 概率条件下基于双目标交替优化的知识表示模型[J]. 广东工业大学学报, 2022, 39(4): 24-31. DOI: 10.12052/gdutxb.210062.
Zhang Xin, Wang Zhen-you. A Knowledge Representation Model Based on Bi-Objective Alternate Optimization Under Probability[J]. 2022, 39(4): 24-31. DOI: 10.12052/gdutxb.210062.
针对TransD模型参数多和实体两种表示间没有关联的问题,提出一种改进的知识表示模型PTransD。通过减少实体投影数
并对实体进行聚类来减少参数量,同时利用K-L(Kullback-Leibler)散度限制实体投影和对应实体类,使其概率分布相同。在模型训练时,对三元组损失和K-L损失交替优化,从类间距大的实体类中替换实体,提高负例质量。最后,在知识图谱数据集上进行三元组分类和链接预测实验。结果表明,该模型的性能在各项指标上均有明显提高,可以应用于知识图谱的完善和推理等。
Aiming at the problem that the TransD model has many parameters and the two representations of entities are not related
an improved knowledge representation model PTransD is proposed
which reduces the number of parameters by reducing the number of entity projections and clustering entities
while using K-L (Kullback-Leibler ) The divergence limits the entity projection to the same probability distribution as the corresponding entity class. During model training
the triple loss and K-L loss are alternately optimized
and the entities in the classes with large spacing between the entities are replaced to improve the quality of negative examples. Finally
based on the experimental results of triple classification and link prediction on the knowledge graph data set
the performance has been significantly improved in various indicators. It can be applied to the perfection and reasoning of knowledge map.
LENAT D B, PRAKASH M, SHEPHERD M. CYC: using common sense knowledge to overcome brittleness and knowledge acquisition bottlenecks [J]. AI Magazine, 1985, 6(4): 65.
MILLER G A. WordNet [J]. Communications of the ACM, 1995, 38(11): 39-41.
BOLLACKER K, COOK R, TUFTS P. Freebase: ashared database of structured general human knowledge[C]//Proceedings of the Twenty-Second AAAI Conference on Artificial Intelligence. Vancouver: AAAI Press, 2007: 1962-1963.
HUANG X, ZHANG J, LI D, et al. Knowledge graph embedding based question answering [C]//Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining. New York: ACM, 2019: 105-113.
DAI Y, WANG S, XIONG N N, et al . A survey on knowledge graph embedding: approaches, applications and benchmarks [J ] . Electronics, 2020, 9(5): 750.
MIKOLOV T, SUTSKEVER I, CHEN K, et al . Distributed representations of words and phrases and their compositionality [J ] . Advances in Neural Information Processing Systems, 2013, 26: 3111-3119.
BORDES A, USUNIER N, GARCIA-DURAN A, et al. Translating embeddings for modeling multi-relational data[C]// Proceedings of the 26th International Conference on Neural Information Processing Systems. Lake Tahoe: NIPS, 2013: 2787-2795.
LIN Y, LIU Z, SUN M, et al. Learning entity and relation embeddings for knowledge graph completion[C]//Proceedings of the AAAI Conference on Artificial Intelligence. Austin: AAAI Press, 2015: 2181-2187.
JI G, HE S, XU L, et al. Knowledge graph embedding via dynamic mapping matrix[C] //Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing. Beijing: ACL, 2015: 687-696.
WANG H, ZHANG F, ZHAO M, et al. Multi-task feature learning for knowledge graph enhanced recommendation[C]//Proceedings of the 2019 World Wide Web Conference. San Francisco: ACM, 2019: 2000-2010.
WANG Z, ZHANG J, FENG J, et al. Knowledge graph embedding by translating on hyperplanes[C] //In Proceedings of the Twenty-eighth AAAI Conference on Artificial Intelligence. Québec City: AAAI Press, 2014: 1112–1119.
DO K, TRAN T, VENKATESH S. Knowledge graph embedding with multiple relation projections[C]// 2018 24th International Conference on Pattern Recognition. Beijing: IEEE, 2018: 332-337.
ZHU Q, ZHOU X, TAN J, et al. Learning knowledge graph embeddings via generalized hyperplanes[C] //Proceedings of the 18th International Conference on Computational Science. Wuxi: Springer, 2018: 624-638.
BORDES A, GLOROT X, WESTON J, et al. Joint learning of words and meaning representations for open-text semantic parsing[C]// Proceedings of the Fifteenth International Conference on Artificial Intelligence and Statistics. La Palma: PMLR, 2012: 127-135.
BORDES A, WESTON J, COLLOBERT R, et al. Learning structured embeddings of knowledge bases[C]//In Proceedings of the Twenty-eighth AAAI Conference on Artificial Intelligence. San Francisco: AAAI Press, 2011: 301–306.
BORDES A, GLOROT X, WESTON J, et al . A semantic matching energy function for learning with multi-relational data [J ] . Machine Learning, 2014, 94(2): 233-259.
0
浏览量
0
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621