吉林大学学报(信息科学版) ›› 2026, Vol. 44 ›› Issue (4): 851-862.

• • 上一篇    下一篇

基于 Transformer 的半监督偏多标签图像分类方法

李 艳1,2 , 周志龙3 , 祝 彪4   

  1. 1. 北京师范大学 文理学院, 广东 珠海 519085; 2. 北京师范大学珠海分校 应用数学学院, 广东 珠海 519087;
    3. 北京师范大学 统计学院, 北京 100875; 4. 河北大学 数学与信息科学学院, 河北 保定 071002
  • 收稿日期:2025-08-29 出版日期:2026-08-06 发布日期:2026-08-06
  • 作者简介:李艳(1976— ), 女, 河北衡水人, 北京师范大学教授, 博士, 硕士生导师, 主要从事机器学习、 不确定信息处理等研究, (Tel)86-13733220291(E-mail)ly@ bnuz. edu. cn
  • 基金资助:
    国家自然科学基金资助项目(61976141)

Transformer-Based Image Classification Method of Semi-Supervised Partial Multi-Label

LI Yan1,2, ZHOU Zhilong3, ZHU Biao4   

  1. 1. Faculty of Arts and Sciences, Beijing Normal University, Zhuhai 519085, China; 2. School of Applied Mathematics,Beijing Normal University at Zhuhai, Zhuhai 519087, China; 3. School of Statistics, Beijing Normal University, Beijing 100875, China;4. College of Mathematics and Information Science, Hebei University, Baoding 071002, China
  • Received:2025-08-29 Online:2026-08-06 Published:2026-08-06

摘要:

针对在半监督偏多标签学习( SSPML: Semi-Supervised Partial Multi_Label Learning) 方法中, 特征和标签空间之间以及各自内部存在复杂的相关性, 且利用标签相关性构建模型时, 容易受到候选标签集中噪声标签干扰的问题, 基于 Transformer 提出一种新的半监督偏多标签图像分类算法 T-SSPML(Transformer Encoder-Based Semi-Supervised Partial Multi-Label Learning)。利用 Transformer 编码器构建主干网络, 将图像和标签特征共同作为输入, 并定义新的损失函数, 利用多头自注意力机制学习整体性结构信息以及标签间的关联信息。同时采用标签掩码机制, 提升模型学习标签关联信息的能力。通过在多个数据集上实验结果表明, T-SSPML 算法相比其他对比算法在绝大多数情况下都取得了更好的分类性能。

关键词:

Abstract:

In SSPML( Semi-Supervised Partial Multi-Label Learning), complex correlations exist between the feature and label, and within them. Models leveraging label correlations are susceptible to interference from noisy labels in candidate label sets. T-SSPML ( Transformer Encoder-Based Semi-Supervised Partial Multi-Label Learning), a novel semi-supervised partial multi-label image classification algorithm is proposed based on Transformer. A backbone network is constructed using Transformer encoders, taking both image features and label features as joint inputs, and a new loss function is defined. The multi-head self-attention mechanism is employed to capture holistic structural information and label interdependencies. A label masking mechanism is
introduced to enhance the model’s capability in learning label correlation information. Extensive experiments on multiple datasets demonstrate that the T-SSPML algorithm achieves superior classification performance compared to other representative methods in most cases.

Key words:

中图分类号: 

  • TP181