1. 广东工业大学 计算机学院,广东,广州,510006
2. 广东工业大学 自动化学院,广东,广州,510006
刘锦能(1996–) ,男,硕士研究生,主要研究方向为支持向量机
刘波(1978–) ,男,教授,博士,主要研究方向为机器学习、数据挖掘,E-mail:csboliu@163.com
网络首发:2024-01-25,
纸质出版:2024
移动端阅览
刘锦能, 肖燕珊, 刘波. 基于最小二乘孪生支持向量机的不确定数据学习算法[J]. 广东工业大学学报, 2024, 41(1): 79-85.
Liu Jin-neng, Xiao Yan-shan, Liu Bo. A Least Squares Twin Support Vector Machine Method with Uncertain Data[J]. 2024, 41(1): 79-85.
刘锦能, 肖燕珊, 刘波. 基于最小二乘孪生支持向量机的不确定数据学习算法[J]. 广东工业大学学报, 2024, 41(1): 79-85. DOI: 10.12052/gdutxb.220027.
Liu Jin-neng, Xiao Yan-shan, Liu Bo. A Least Squares Twin Support Vector Machine Method with Uncertain Data[J]. 2024, 41(1): 79-85. DOI: 10.12052/gdutxb.220027.
孪生支持向量机通过计算2个二次规划问题,得到2个不平行的超平面,用于解决二分类问题。然而在实际的应用中,数据通常包含不确定信息,这将会对构建模型带来困难。对此,提出了一种用于求解带有不确定数据的最小二乘孪生支持向量机模型。首先,对于每个实例,该方法都分配一个噪声向量来构建噪声信息。其次,将噪声向量结合到最小二乘孪生支持向量机,并在训练阶段得到优化。最后,采用一个2步循环迭代的启发式框架求解得到分类器和更新噪声向量。实验表明,跟其他对比方法比较,本方法采用噪声向量对不确定信息进行建模,并将孪生支持向量机的二次规划问题转化为线性方程,具有更好的分类精度和更高的训练效率。
Twin support vector machine learns two nonparallel hyperplanes by calculating two quadratic programming problems to solve the binary classification problems. However
in practical applications
the data usually contain uncertain information
making it difficult to construct the classification model. This paper proposed a new and efficient uncertain-data-based least squares twin support vector machine (ULSTSVM) method to address the problem of data uncertainty. Firstly
since the data may contain uncertain information
a noise vector was introduced to model the uncertain information of each example. Secondly
the noise vectors were incorporated into the least squares TWSVM. Finally
to solve the derived learning problem
we employed a two-step heuristic framework to train the least squares TWSVM classifier and updated the noise vectors alternatively. The experiments showed that our proposed ULSTSVM outperforms the baselines in training time and meanwhile achieves comparable classification accuracy. In sum
ULSTSVM adopts a noise vector to model the uncertain information and transforms the quadratic programming problems of TWSVM into linear equations
such that better classification accuracy and higher training efficiency can be obtained.
CORTES C, VAPNIK V. Support-vector networks [J]. Machine Learning, 1995, 20(3): 273-297.
LI S, KWOK J T, ZHU H, et al . Texture classification using the support vector machines [J ] . Pattern Recognition, 2003, 36(12): 2883-2893.
KHAN N M, KSANTITI R, AHMAD I S, et al . A novel SVM+NDA model for classification with an application to face recognition [J ] . Pattern Recognition, 2012, 45(1): 66-79.
BILAL M. Algorithmic optimisation of histogram intersection kernel support vector machine-based pedestrian detection using low complexity features [J]. IET Computer Vision, 2017, 11(5): 350-357.
YUAN L, YAO E, TAN G. Automated and precise event detection method for big data in biomedical imaging with support vector machine [J]. International Journal of Computer Systems Science Engineering, 2018, 33(2): 105-113.
MANGASARIAN O L, WILD E W. Multisurface proximal support vector machine classification via generalized eigenvalues [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 28(1): 69-74.
KHEMCHANDANI R, CHANDRA S. Twin support vector machines for pattern classification [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29(5): 905-910.
CHEN X, YANG J, YE Q, et al . Recursive projection twin support vector machine via within-class variance minimization [J ] . Pattern Recognition, 2011, 44(10-11): 2643-2655.
SHAO Y H, ZHANG C H, WANG X B, et al . Improvements on twin support vector machines [J ] . IEEE Transactions on Neural Networks, 2011, 22(6): 962-968.
KUMAR M A, GOPAL M. Least squares twin support vector machines for pattern classification [J]. Expert Systems with Applications, 2009, 36(4): 7535-7543.
KUMAR M A, KHEMCHANDANI R, GOPAL M, et al . Knowledge based least squares twin support vector machines [J ] . Information Sciences, 2010, 180(23): 4606-4618.
TANVEER M, SHARMA S, MUHAMMAD K. Large-scale least squares twin svms [J]. ACM Transactions on Internet Technology (TOIT) , 2021, 21(2): 1-19.
CHEN S G, WU X J, XU J. Locality preserving projection least squares twin support vector machine for pattern classification [J]. Pattern Analysis and Applications, 2020, 23(1): 1-13.
QI Z, TIAN Y, SHI Y. Robust twin support vector machine for pattern classification [J]. Pattern Recognition, 2013, 46(1): 305-316.
MAIRAL J, BACH F, PONCE J, et al. Online dictionary learning for sparse coding[C]//Proceedings of the 26th Annual International Conference on Machine Learning. New York: ACM, 2009: 689-696.
ZHAO B, WANG F, ZHANG C. Efficient multiclass maximum margin clustering[C]//Proceedings of the 25th International Conference on Machine Learning. New York: ACM, 2008: 1248-1255.
LIU B, XIAO Y, CAO L, et al. One-class-based uncertain data stream learning[C]//Proceedings of the 2011 SIAM International Conference on Data Mining. Society for Industrial and Applied Mathematics. Philadelphia: SIAM, 2011: 992-1003.
BI J, ZHANG T. Support vector classification with input data uncertainty[C]//Neural Information Processing Systems. Cambridge: MIT Press, 2004: 161-168.
TSANG S, KAO B, YIP K Y, et al . Decision trees for uncertain data [J ] . IEEE Transactions on Knowledge and Data Engineering, 2009, 23(1): 64-7 8.
REN J, LEE S D, CHEN X, et al. Naive bayes classification of uncertain data[C]//2009 Ninth IEEE International Conference on Data Mining. Piscataway: IEEE, 2009: 944-949.
GAO C, WANG J. Direct mining of discriminative patterns for classifying uncertain data[C]//Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York: ACM, 2010: 861-870.
YIN J, YANG Q, PAN J J. Sensor-based abnormal human-activity detection [J]. IEEE Transactions on Knowledge and Data Engineering, 2008, 20(8): 1082-1090.
0
浏览量
0
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621