Zhang Wei, Mai Zhi-shen. A Research on Local Outlier Factor De-noising Method for Kernel Fuzzy Spectral Clustering[J]. 2018, 35(6): 77-82.DOI: 10.12052/gdutxb.180053.
A Research on Local Outlier Factor De-noising Method for Kernel Fuzzy Spectral Clustering
To deal with noise reduction of kernel fuzzy spectral clustering for obtaining a better cluster capability
a new spectral clustering based on local outlier factor was presented. With the proposed method the distribution features of outliers were analyzed. Based on the analysis result
the cluster center candidate object was proposed by using local filter factor algorithm. And then a process was constructed to filter the noise data and highlighted normal data’s influence in the clustering center adjustment. Secondly
the local filter factor was presented by using local outlier factor between two arbitrary objects. Then the local filter factor was used as weighting factor to improve the similarity measure of kernel fuzzy spectral clustering. The improved similarity measure made weight between normal data and normal data became bigger and weight between normal data and noise data smaller. Therefore
the improved kernel fuzzy spectral clustering can reduce greatly the sensitivity of outliers. The validity experiment and stability experiment results show the proposed method has better clustering accuracy and robustness.
关键词
Keywords
references
SHAH M, NAIR S. A survey of data mining clustering algorithms [J]. International Journal of Computer Applications, 2015, 128(1): 1-5.
NG A Y, JORDAN M I, WEISS Y. On spectral clustering: Analysis and an algorithm[C]//14th International Conference on Neural Information Processing Systems: Natural and Synthetic. Vancouver: MIT Press, 2002: 849-856.
VONLUXBURG U. A tutorial on spectral clustering [J]. Statistics and Computing, 2007, 17(4): 395-416.
TENG S H, WU H, LI R G, et al . The application of the adjustable multi-times clustering algorithm in telecom data [J ] . Journal of Guangdong University of Technology, 2014, 31(3): 1-7.
HAN J, PEI J, KAMBER M. Data mining: concepts and techniques[M].[S.l.]: Elsevier, 2011.
ZHANG W, HUANG J H, LIU D N, et al . An improved recommendation method using rating and review information [J ] . Journal of Guangdong University of Technology, 2017, 34(6): 27-31.
YANG Y, WANG Y, CHEUNG Y. Kernel fuzzy similarity measure-based spectral clustering for image segmentation[C]//International Conference on Human-Computer Interaction. Berlin, Heidelberg: Springer, 2013: 246-253.
ZHAO F, LIU H, JIAO L. Spectral clustering with fuzzy similarity measure [J]. Digital Signal Processing, 2011, 21(6): 701-709.
LI Q, REN Y, LI L, et al . Fuzzy based affinity learning for spectral clustering [J ] . Pattern Recognition, 2016, 60: 531-542.
BREUNIG M M, KRIEGEL H P, NG R T, et al. LOF: identifying density-based local outliers[C]// ACM SIGMOD International Conference on Management of Data. Dallas: ACM, 2000, 29(2): 93-104.
CHEN W Y, SONG Y, BAI H, et al . Parallel spectral clustering in distributed systems [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(3): 568-586.
GOYAL S, KUMAR S, ZAVERI M A, et al . Fuzzy similarity measure based spectral clustering framework for noisy image segmentation [J ] . International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 2017, 25(4): 649-673.
AKOGLU L, TONG H, KOUTRA D. Graph based anomaly detection and description: a survey [J]. Data Mining and Knowledge Discovery, 2015, 29(3): 626-688.
CELEBI M E, KINGRAVI H A, VELA P A. A comparative study of efficient initialization methods for the k-means clustering algorithm [J]. Expert Systems with Applications, 2013, 40(1): 200-210.
MEILA M, SHI J. Learning segmentation by random walks[C]//Advances in Neural Information Processing Systems. Cambridge: MIT Press, 2001: 873-879.
WU M, SCHOLKOPF B. A local learning approach for clustering[C]//Advances in Neural Information Processing Systems. Cambridge: MIT Press, 2007: 1529-1536.