Journal of Jilin University Science Edition ›› 2024, Vol. 62 ›› Issue (5): 1155-1162.

Previous Articles     Next Articles

Entity-Relation Joint Extraction Model Based on Contrastive Learning and Gradient Penalty

ZHANG Qiang, ZENG Junwei, CHEN Rui   

  1. School of Computer and Information Technology, Northeast Petroleum University, Daqing 163318, Heilongjiang Province, China
  • Received:2023-08-20 Online:2024-09-26 Published:2024-09-26

Abstract: Aiming at  the problem of sparse entity relationship type data with unclear feature information when using global pointer networks for entity relationship extraction, as well as the problem of class imbalance and incorrect labeling in the data, we proposed a entity-relation joint extraction model based on  contrastive learning and gradient penalty methods while utilizing an enhanced RoBERTa pre-trained model. Experimental results on the Alibaba Tianchi Chinese medical information processing benchmark CBLUE2.0 dataset show  that this model outperforms the global pointer network, and can more  effectively extract  entity relationship from complex data.

Key words: entity relation extraction, contrastive learning, gradient penalty, RoBERTa pre-trained model, global pointer network

CLC Number: 

  • TP18