A Least Squares Twin Support Vector Machine Method with Uncertain Data

Liu Jin-neng; Xiao Yan-shan; Liu Bo

doi:10.12052/gdutxb.220027

English Version Journal Login

您当前的位置：

首页 >

文章列表页 >

A Least Squares Twin Support Vector Machine Method with Uncertain Data

更新时间：2026-05-27

- A Least Squares Twin Support Vector Machine Method with Uncertain Data
- Vol. 41, Issue 1, Pages: 79-85(2024)
- 作者机构：
  
  1. 广东工业大学计算机学院,广东,广州,510006
  2. 广东工业大学自动化学院,广东,广州,510006
- 作者简介：
- 基金信息：
- DOI：10.12052/gdutxb.220027
  CLC： TP391
- Online First：25 January 2024，
  
  Published：2024
- 稿件说明：
移动端阅览
刘锦能, 肖燕珊, 刘波. 基于最小二乘孪生支持向量机的不确定数据学习算法[J]. 广东工业大学学报, 2024, 41(1): 79-85.

Liu Jin-neng, Xiao Yan-shan, Liu Bo. A Least Squares Twin Support Vector Machine Method with Uncertain Data[J]. 2024, 41(1): 79-85.
刘锦能, 肖燕珊, 刘波. 基于最小二乘孪生支持向量机的不确定数据学习算法[J]. 广东工业大学学报, 2024, 41(1): 79-85. DOI： 10.12052/gdutxb.220027.

Liu Jin-neng, Xiao Yan-shan, Liu Bo. A Least Squares Twin Support Vector Machine Method with Uncertain Data[J]. 2024, 41(1): 79-85. DOI： 10.12052/gdutxb.220027.

摘要

孪生支持向量机通过计算2个二次规划问题，得到2个不平行的超平面，用于解决二分类问题。然而在实际的应用中，数据通常包含不确定信息，这将会对构建模型带来困难。对此，提出了一种用于求解带有不确定数据的最小二乘孪生支持向量机模型。首先，对于每个实例，该方法都分配一个噪声向量来构建噪声信息。其次，将噪声向量结合到最小二乘孪生支持向量机，并在训练阶段得到优化。最后，采用一个2步循环迭代的启发式框架求解得到分类器和更新噪声向量。实验表明，跟其他对比方法比较，本方法采用噪声向量对不确定信息进行建模，并将孪生支持向量机的二次规划问题转化为线性方程，具有更好的分类精度和更高的训练效率。

Abstract

Twin support vector machine learns two nonparallel hyperplanes by calculating two quadratic programming problems to solve the binary classification problems. However

in practical applications

the data usually contain uncertain information

making it difficult to construct the classification model. This paper proposed a new and efficient uncertain-data-based least squares twin support vector machine (ULSTSVM) method to address the problem of data uncertainty. Firstly

since the data may contain uncertain information

a noise vector was introduced to model the uncertain information of each example. Secondly

the noise vectors were incorporated into the least squares TWSVM. Finally

to solve the derived learning problem

we employed a two-step heuristic framework to train the least squares TWSVM classifier and updated the noise vectors alternatively. The experiments showed that our proposed ULSTSVM outperforms the baselines in training time and meanwhile achieves comparable classification accuracy. In sum

ULSTSVM adopts a noise vector to model the uncertain information and transforms the quadratic programming problems of TWSVM into linear equations

such that better classification accuracy and higher training efficiency can be obtained.

关键词

Keywords

references

CORTES C, VAPNIK V. Support-vector networks [J]. Machine Learning, 1995, 20(3): 273-297.

LI S, KWOK J T, ZHU H, et al . Texture classification using the support vector machines [J ] . Pattern Recognition, 2003, 36(12): 2883-2893.

KHAN N M, KSANTITI R, AHMAD I S, et al . A novel SVM+NDA model for classification with an application to face recognition [J ] . Pattern Recognition, 2012, 45(1): 66-79.

BILAL M. Algorithmic optimisation of histogram intersection kernel support vector machine-based pedestrian detection using low complexity features [J]. IET Computer Vision, 2017, 11(5): 350-357.

YUAN L, YAO E, TAN G. Automated and precise event detection method for big data in biomedical imaging with support vector machine [J]. International Journal of Computer Systems Science Engineering, 2018, 33(2): 105-113.

MANGASARIAN O L, WILD E W. Multisurface proximal support vector machine classification via generalized eigenvalues [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 28(1): 69-74.

KHEMCHANDANI R, CHANDRA S. Twin support vector machines for pattern classification [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29(5): 905-910.

CHEN X, YANG J, YE Q, et al . Recursive projection twin support vector machine via within-class variance minimization [J ] . Pattern Recognition, 2011, 44(10-11): 2643-2655.

SHAO Y H, ZHANG C H, WANG X B, et al . Improvements on twin support vector machines [J ] . IEEE Transactions on Neural Networks, 2011, 22(6): 962-968.

KUMAR M A, GOPAL M. Least squares twin support vector machines for pattern classification [J]. Expert Systems with Applications, 2009, 36(4): 7535-7543.

KUMAR M A, KHEMCHANDANI R, GOPAL M, et al . Knowledge based least squares twin support vector machines [J ] . Information Sciences, 2010, 180(23): 4606-4618.

TANVEER M, SHARMA S, MUHAMMAD K. Large-scale least squares twin svms [J]. ACM Transactions on Internet Technology (TOIT) , 2021, 21(2): 1-19.

CHEN S G, WU X J, XU J. Locality preserving projection least squares twin support vector machine for pattern classification [J]. Pattern Analysis and Applications, 2020, 23(1): 1-13.

QI Z, TIAN Y, SHI Y. Robust twin support vector machine for pattern classification [J]. Pattern Recognition, 2013, 46(1): 305-316.

MAIRAL J, BACH F, PONCE J, et al. Online dictionary learning for sparse coding[C]//Proceedings of the 26th Annual International Conference on Machine Learning. New York: ACM, 2009: 689-696.

ZHAO B, WANG F, ZHANG C. Efficient multiclass maximum margin clustering[C]//Proceedings of the 25th International Conference on Machine Learning. New York: ACM, 2008: 1248-1255.

LIU B, XIAO Y, CAO L, et al. One-class-based uncertain data stream learning[C]//Proceedings of the 2011 SIAM International Conference on Data Mining. Society for Industrial and Applied Mathematics. Philadelphia: SIAM, 2011: 992-1003.

BI J, ZHANG T. Support vector classification with input data uncertainty[C]//Neural Information Processing Systems. Cambridge: MIT Press, 2004: 161-168.

TSANG S, KAO B, YIP K Y, et al . Decision trees for uncertain data [J ] . IEEE Transactions on Knowledge and Data Engineering, 2009, 23(1): 64-7 8.

REN J, LEE S D, CHEN X, et al. Naive bayes classification of uncertain data[C]//2009 Ninth IEEE International Conference on Data Mining. Piscataway: IEEE, 2009: 944-949.

GAO C, WANG J. Direct mining of discriminative patterns for classifying uncertain data[C]//Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York: ACM, 2010: 861-870.

YIN J, YANG Q, PAN J J. Sensor-based abnormal human-activity detection [J]. IEEE Transactions on Knowledge and Data Engineering, 2008, 20(8): 1082-1090.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Point Cloud Module Based on Hidden Features

Bimodal Iterative Cross-attention Fusion Ensemble Framework

Classification Method Based on Dimension Reduction

Research on ESGS Contradiction Problem Modeling

SCA-YOLO: Real-time Target Detection Based on Deformable Convolution and Context-aware Attention

Related Author

Gao Xiang

Li Guangping

Zou Shuhang

Ye Jiayu

Pan Dan

Xie Jianping

Zeng An

Pan Dan

Related Institution

School of Information Engineering, Guangdong University of Technology

School of Electronics and Information Engineering, Guangdong Polytechnic Normal University

School of Electronics and Information Technology, Guangdong Technical Normal University

AI问答

⁰