Journal of Jilin University (Information Science Edition) ›› 2024, Vol. 42 ›› Issue (3): 406-420.

Previous Articles     Next Articles

Adaptive Detection Method for Concept Evolution Based on Weakly Supervised Ensemble

WANG Jing a , GUO Husheng a,b , WANG Wenjian a,b   

  • Received:2023-05-26 Online:2024-06-18 Published:2024-06-17
  • About author:王婧(1999— ), 女, 山西离石人, 山西大学硕士研究生, 主要从事数据挖掘研究, ( Tel) 86-15525088854 ( E-mail) 1756645158@ qq. com;

Abstract:  Most of the existing detection methods for concept evolution are essentially based on supervised learning and are often used to solve the problem that only one novel class appears in a period of time. However, they can not handle the task of a class disappearing and recurring in streaming data. To address the above problems, an adaptive detection method for concept evolution based on weakly supervised ensemble (AD_WE) is proposed. The weakly supervised ensemble strategy is used to construct an ensemble learner to make local predictions on the training samples in the data block. Similar data with strong cohesion in the feature space are detected and clustered using local density and relative distance. The similarity of the clustering results is then compared to detect novel class instances and distinguish between different novel classes. And a dynamic decay model is established according to the characteristics of data change over time. The vanished class is eliminated in time, and the recurring class is detected through similarity comparison. Experiments show that the proposed method can respond to concept evolution in a timely manner, effectively identify vanished classes and recurring classes, and improve the generalization performance of the learner.

Key words: concept evolution, weakly supervised ensemble, adaptive model, dynamic decay model, vanished class, recurring class

CLC Number: 

  • TP181