基于DC规划方法的稀疏最小二乘支持向量机
作者:
作者单位:

作者简介:

通讯作者:

基金项目:

国家自然科学基金面上项目(No.12171063);重庆市自然科学基金项目(No.cstc2022ycjh-bgzxm0114);重庆市教委科技项目(No.KJQN 202100521)


Sparse Least Squares Support Vector Machines via DC Programming
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
    摘要:

    最小二乘支持向量机(LS-SVM)是一种基于超平面的分类器,由于LS-SVM缺乏特征选择能力,因此在高维小样本数据集上的泛化表现不佳,所以有必要提高LS-SVM的特征选择能力。在LS-SVM的目标函数中引入e0-范数正则项,提升模型的特征选择能力。然而由于e0-范数的引入,导致新的模型不仅是非凸非光滑的,而且是NP-难问题。为了克服这些困难,首先用一个非凸非光滑连续函数近似e0-范数,再对该近似函数进行DC(difference of convex functions)分解,将问题转化为DC规划问题,从而利用DCA(difference of convex functions algorithm)求解该问题。该新方法的主要优点在于DCA的子问题具有解析解,从而使得训练速度得到很大地提升。数值实验表明,本文所提出的新方法不仅具有较好的泛化性能和特征选择能力,而且计算速度快。

    Abstract:

    Least squares support vector machines (LS-SVM) is a hyperplane-based classifier. Due to the lack of feature selection ability, LS-SVM does not perform well on high-dimensional small sample data sets.Thus it is necessary to improve the feature selection ability of LS-SVM. The e0-norm regular term is introduced into the objective function of LS-SVM to enhance the feature selection ability of the model. However, due to the presence of the e0-norm, the new model is not only non-convex and non-smooth, but also NP-hard. In order to overcome these difficulties, a non-convex non-smooth continuous function was first used to approximate the e0-norm and then the approximate function is decomposed into a DC (difference of convex functions) programming problem, and the DCA (difference of convex functions algorithm) is used to solve the problem. The main advantage of the new method is that the subproblems of DCA have closed form solutions, which greatly improves the training speed. Numerical experiments show that the proposed new method not only has better generalization performance and feature selection ability, but also has fast computation speed.

    参考文献
    相似文献
    引证文献
引用本文

唐青青,李国权.基于DC规划方法的稀疏最小二乘支持向量机[J].重庆师范大学学报自然科学版,2023,40(6):7-14

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2024-02-27