基于DC规划的L1范数稀疏线性判别分析
作者:
作者单位:

作者简介:

通讯作者:

基金项目:

国家自然科学基金面上项目(No.11871128,No.12171063);重庆市教育委员会科学技术研究计划重点项目(No.KJZD-K202300509)


L1 Norm Sparse Linear Discriminant Analysis Based on DC Programming
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
    摘要:

    针对传统线性判别分析抗噪性能不足,以及在高维小样本数据集上(即样本特征数量远远大于样本个数)泛化性能不佳等问题,现有文献提出了鲁棒线性判别分析(robust linear discriminant analysis,RLDA)和鲁棒稀疏线性判别分析(robust sparse linear discriminant analysis,RSLDA)模型,并提出基于交替方向乘子法的优化算法求解RLDA和RSLDA模型。但上述算法不具备收敛性,在有些数据集上算法不收敛。因此,根据RLDA、RSLDA的模型结构特点,提出一种基于DC函数规划的优化算法DC_SLDA,该算法通过将原问题的目标函数进行DC分解,转换为DC规划问题,进而利用DC算法进行迭代求解。所提出的算法不仅具有收敛性保证而且子问题具有解析解,使得模型的训练效率得到明显提升。

    Abstract:

    To address traditional linear discriminant analysis’s insufficient robustness to noise and poor generalization performance on high-dimensional datasets with small sample sizes (i.e., where the number of features far exceeds the number of samples), literature proposed robust linear discriminant analysis (RLDA) and robust sparse linear discriminant analysis (RSLDA), along with an ADMM-based optimization algorithm for solving them. However, this method lacks convergence guarantees and fails to converge on some datasets. Based on the structural features of RLDA and RSLDA, an improved optimization algorithm DC_SLDA based on differences of convex functions (DC) programming is proposed. The algorithm transforms the original problem into a DC programming problem through DC decomposition, and then applies the difference of convex functions algorithm for iterative solution. The algorithm proposed not only has convergence guarantees but also features closed-form solutions for its subproblems, which significantly improves the training efficiency of the model.

    参考文献
    相似文献
    引证文献
引用本文

翁婷,李国权,张家豪.基于DC规划的L1范数稀疏线性判别分析[J].重庆师范大学学报自然科学版,2025,42(6):22-29

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-02-11