广东工业大学 计算机学院,广东,广州,510006
张巍(1964–),女,副教授,主要研究方向为协同计算、数据挖掘、大数据. E-mail:weizhang@gdut.edu.cn
网络首发:2018-11-23,
纸质出版:2018
移动端阅览
张巍, 麦志深. 核模糊谱聚类LOF降噪方法研究[J]. 广东工业大学学报, 2018, 35(6): 77-82.
Zhang Wei, Mai Zhi-shen. A Research on Local Outlier Factor De-noising Method for Kernel Fuzzy Spectral Clustering[J]. 2018, 35(6): 77-82.
张巍, 麦志深. 核模糊谱聚类LOF降噪方法研究[J]. 广东工业大学学报, 2018, 35(6): 77-82. DOI: 10.12052/gdutxb.180053.
Zhang Wei, Mai Zhi-shen. A Research on Local Outlier Factor De-noising Method for Kernel Fuzzy Spectral Clustering[J]. 2018, 35(6): 77-82. DOI: 10.12052/gdutxb.180053.
为解决核模糊相似性度量谱聚类算法的样本点降噪问题
优化聚类效果和稳定性
本文从分析异常点分布特性出发
引入局部异常因子(LOF)算法
提出聚类中心候选对象的概念
过滤数据集的噪声数据
从而优化初始聚类中心的计算
突出正常样本点在聚类中心调整中的影响力
使聚类算法更易于得出准确的聚类结果. 同时提出一种局部过滤因子以修正相似性度量的方法
该方法通过放大正常数据之间的权值、缩小正常数据与噪声数据间的权值
使优化后的核模糊谱聚类算法大大降低对异常点的敏感度. 算法有效性实验和算法稳定性实验表明: 该方法对相似性度量修正的有效性使核模糊谱聚类算法更为稳定和鲁棒.
To deal with noise reduction of kernel fuzzy spectral clustering for obtaining a better cluster capability
a new spectral clustering based on local outlier factor was presented. With the proposed method the distribution features of outliers were analyzed. Based on the analysis result
the cluster center candidate object was proposed by using local filter factor algorithm. And then a process was constructed to filter the noise data and highlighted normal data’s influence in the clustering center adjustment. Secondly
the local filter factor was presented by using local outlier factor between two arbitrary objects. Then the local filter factor was used as weighting factor to improve the similarity measure of kernel fuzzy spectral clustering. The improved similarity measure made weight between normal data and normal data became bigger and weight between normal data and noise data smaller. Therefore
the improved kernel fuzzy spectral clustering can reduce greatly the sensitivity of outliers. The validity experiment and stability experiment results show the proposed method has better clustering accuracy and robustness.
SHAH M, NAIR S. A survey of data mining clustering algorithms [J]. International Journal of Computer Applications, 2015, 128(1): 1-5.
NG A Y, JORDAN M I, WEISS Y. On spectral clustering: Analysis and an algorithm[C]//14th International Conference on Neural Information Processing Systems: Natural and Synthetic. Vancouver: MIT Press, 2002: 849-856.
VONLUXBURG U. A tutorial on spectral clustering [J]. Statistics and Computing, 2007, 17(4): 395-416.
TENG S H, WU H, LI R G, et al . The application of the adjustable multi-times clustering algorithm in telecom data [J ] . Journal of Guangdong University of Technology, 2014, 31(3): 1-7.
HAN J, PEI J, KAMBER M. Data mining: concepts and techniques[M].[S.l.]: Elsevier, 2011.
ZHANG W, HUANG J H, LIU D N, et al . An improved recommendation method using rating and review information [J ] . Journal of Guangdong University of Technology, 2017, 34(6): 27-31.
YANG Y, WANG Y, CHEUNG Y. Kernel fuzzy similarity measure-based spectral clustering for image segmentation[C]//International Conference on Human-Computer Interaction. Berlin, Heidelberg: Springer, 2013: 246-253.
ZHAO F, LIU H, JIAO L. Spectral clustering with fuzzy similarity measure [J]. Digital Signal Processing, 2011, 21(6): 701-709.
LI Q, REN Y, LI L, et al . Fuzzy based affinity learning for spectral clustering [J ] . Pattern Recognition, 2016, 60: 531-542.
BREUNIG M M, KRIEGEL H P, NG R T, et al. LOF: identifying density-based local outliers[C]// ACM SIGMOD International Conference on Management of Data. Dallas: ACM, 2000, 29(2): 93-104.
CHEN W Y, SONG Y, BAI H, et al . Parallel spectral clustering in distributed systems [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(3): 568-586.
GOYAL S, KUMAR S, ZAVERI M A, et al . Fuzzy similarity measure based spectral clustering framework for noisy image segmentation [J ] . International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 2017, 25(4): 649-673.
AKOGLU L, TONG H, KOUTRA D. Graph based anomaly detection and description: a survey [J]. Data Mining and Knowledge Discovery, 2015, 29(3): 626-688.
CELEBI M E, KINGRAVI H A, VELA P A. A comparative study of efficient initialization methods for the k-means clustering algorithm [J]. Expert Systems with Applications, 2013, 40(1): 200-210.
MEILA M, SHI J. Learning segmentation by random walks[C]//Advances in Neural Information Processing Systems. Cambridge: MIT Press, 2001: 873-879.
WU M, SCHOLKOPF B. A local learning approach for clustering[C]//Advances in Neural Information Processing Systems. Cambridge: MIT Press, 2007: 1529-1536.
0
浏览量
0
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621