Abstract: Aiming at the problem of insufficient feature extraction resulting in low classification accuracy of the traditional encrypted traffic classification model, we  proposd an encrypted traffic classification model based on an improved convolutional neural network combined with Transformer by using deep learning techniques.  In order to improve the classification accuracy, firstly, we cut and filled the dataset,  and completed standardization processing. Secondly, the multi-head attention mechanism in the Transformer network model was used to capture long-distance feature dependencies, and the convolutional neural network was used to extract local features. Finally, the Inception module was added to achieve multi-dimensional feature extraction and feature fusion, and the model training and encrypted traffic classification were completed. The experimental verification was conducted on the 
ISCX VPN-non-VPN 2016 public dataset, the experimental results show that the classification accuracy of the proposed  model reaches 98.5%, with the precision rate, recall rate and F₁ value  all exceeding  98.2%, which show better classification effect compared with other models.

Key words: encrypted traffic classification, convolutional neural network, multi-head attention mechanism, feature fusion