基于云计算和大数据分析的大规模网络流量预测

doi:10.13229/j.cnki.jdxbgxb20200329

Abstract

Abstract:

In order to obtain the ideal network traffic prediction results， a large-scale network traffic prediction model based on cloud computing and big data analysis is proposed. Firstly， according to the chaos algorithm to describe chaos characteristics of network traffic， the learning sample set is established. Then the support vector machine is introduced to model the randomness characteristics of network traffic， and combined with the massive characteristics of historical data， the cloud computing platform is used to make multiple support vector machines run in parallel. Finally， the comparative test results show that the proposed model improves the accuracy of network traffic prediction， and the modeling efficiency is greatly improved， which can meet the real-time requirements of online network traffic management.

Key words: network management, cloud computing technology, parallel modeling, randomness, learning samples, chaos algorithm

CLC Number:

TP393

Xiao-hui LI,Chao-yang CHEN,Hua-wei YI,Bo LI. Large scale network traffic prediction based on cloud computing and big data analysis[J].Journal of Jilin University(Engineering and Technology Edition), 2021, 51(3): 1034-1039.

Figures/Tables 8

Fig.1

Fig.2

Table 1

Table 2

Table 3

Fig.3

Fig.4

Fig.5

References 16

1	Bui N, Widmer J. Data-driven evaluation of anticipatory networking in LTE network[J]. IEEE Trans Mobile Comput, 2018, 17(10):2252-2265.
2	Suh D, Jang S, Han S, et al. Toward highly available and scalable software defined networks for service providers[J]. IEEE Communications Magazine, 2017, 55(4):100-107.
3	Benzaoui N, Estarán J M, Dutisseuil E, et al. CBOSS: bringing traffic engineering inside data center networks[J]. IEEE/OSA Journal of Optical Communications & Networking, 2018, 10(7):117-125.
4	Mohammadi R, Javidan R, Keshtgari M, et al. A novel multicast traffic engineering technique in SDN using TLBO algorithm[J]. Telecommunication Systems, 2018, 68(3):583-592.
5	张蕾,张鹏,孙伟,等. 面向高速网络流量的恶意镜像网站识别方法[J]. 通信学报,2019,40(7):87-94.
	Zhang Lei, Zhang Peng, Sun Wei, et al. An identification method of maliciousmirror website for high-speed network traffic[J]. Journal on Communications,2019,40(7):87-94.
6	董书琴,张斌. 基于深度特征学习的网络流量异常检测方法[J]. 电子与信息学报,2020,42(3):695-703.
	Dong Shu-qin, Zhang Bin. Network traffic anomaly detection method based on deep feature learning[J]. Journal of Electronics & Information Technology, 2020, 42(3):695-703.
7	徐久强,周洋洋,王进法,等. 基于流时间影响域的网络流量异常检测[J]. 东北大学学报:自然科学版, 2019, 40(1):26-31.
	Xu Jiu-qiang, Zhou Yang-yang, Wang Jin-fa, et al. Anomaly detection of network traffic based on flow time influence domain[J]. Journal of Northeastern University (Natural Science), 2019, 40(1):26-31.
8	郭佳,余永斌,杨晨阳. 基于全注意力机制的多步网络流量预测[J]. 信号处理,2019,35(5):758-767.
	Guo Jia, Yu Yong-bin, Yang Chen-yang. Multi-step prediction of traffic load with all-attention mechanism[J]. Journal of Signal Processing, 2019, 35(5): 758-767.
9	李松,周亚同,池越,等. 高斯过程混合模型应用于网络流量预测研究[J]. 计算机工程与应用, 2020, 56(5): 186-193.
	Li Song, Zhou Ya-tong, Chi Yue, et al. Application of Gaussian process mixture model to network traffic prediction[J]. Computer Engineering and Applications, 2020,56(5):186-193.
10	李校林,吴腾. 基于PF-LSTM网络的高效网络流量预测方法[J]. 计算机应用研究, 2019, 36(12):3833-3836.
	Li Xiao-lin, Wu Teng. Efficient network traffic prediction method based on PF-LSTM network[J]. Application Research of Computers, 2019, 36(12): 3833-3836.
11	韩莹,井元伟,金建宇,等. 基于改进黑洞算法优化ESN的网络流量短期预测[J]. 东北大学学报:自然科学版,2018,39(3):311-315.
	Han Ying, Jing Yuan-wei, Jin Jian-yu, et al. Network traffic short-term prediction based on echo state network optimized by improved black hole algorithm[J]. Journal of Northeastern University (Natural Science), 2018,39(3):311-315.
12	田中大,李树江,王艳红,等. 高斯过程回归补偿ARIMA的网络流量预测[J]. 北京邮电大学学报, 2017, 40(6):65-73.
	Tian Zhong-da, Li Shu-jiang, Wang Yan-hong, et al. Network traffic prediction based on ARIMA with gaussian process regression compensation[J]. Journal of Beijing University of Posts and Telecommunications, 2017, 40(6):65-73.
13	闫伟,张军. 基于时间序列分析的网络流量异常检测[J].吉林大学学报:理学版,2017,55(5):1249-1254.
	Yan Wei, Zhang Jun. Network traffic anomaly detection based on time series analysis[J]. Journal of Jilin University (Science Edition), 2017, 55(5):1249-1254.
14	张杰,白光伟,沙鑫磊,等. 基于时空特征的移动网络流量预测模型[J].计算机科学,2019,46(12):108-113.
	Zhang Jie, Bai Guang-wei, Sha Xin-lei, et al. Mobile traffic forecasting model based on spatio-temporal features[J]. Computer Science, 2019, 46(12):108-113.
15	袁开银,魏彬. 相空间重构和极限学习机的网络流量预测模型[J]. 控制工程,2018,25(11):2087-2091.
	Yuan Kai-yin, Wei Bin. Network traffic prediction based on phase space reconstruction and ELM[J]. Control Engineering of China, 2018, 25(11):2087-2091.
16	余乐正,柳凤娟,李东海,等. 基于支持向量机的癌细胞经典分泌蛋白与非经典分泌蛋白识别研究[J]. 四川大学学报:自然科学版,2020,57(1):152-156.
	Yu Le-zheng, Liu Feng-juan, Li Dong-hai, et al. A study on recognition of classically and non-classically secreted proteins from cancer cells based on support vector machine[J]. Journal of Sichuan University (Natural Science Edition), 2020, 57(1):152-156.

Related Articles 8

[1]	GAO Yin-han,WANG Tian-hao,YANG Kai-yu,ZHANG Jun-dong,FAN Kuan-gang,ZHU Yu. Prediction of the dynamic crosstalk of automotive wiring hardness [J]. 吉林大学学报(工学版), 2014, 44(5): 1258-1263.
[2]	QIN Gui-he, NAN Yang, CHEN Yun-han, CANG Chen-yang, HE Wei-min. Connection management strategy in media oriented systems transport network [J]. , 2012, 42(04): 963-970.
[3]	YANG Zhi-xiao, FAN Yan-feng, SUN Fu-yan. Uncertainty control based on normal cloud model for nodding actions of virtual human [J]. 吉林大学学报(工学版), 2012, 42(02): 476-482.
[4]	LIN Dan, WANG Wen-hai. PCs communication based on EPL [J]. 吉林大学学报(工学版), 2011, 41(增刊1): 314-318.
[5]	CHEN Bing-Kun, SHEN Gui-Xiang, ZHANG Ying-Zhi, WANG Xiao-Feng, GAO Wen-Li, WANG Zhi-Qiong. Dynamical criticality analysis of CNC machine tool based on random and fuzzy theory [J]. 吉林大学学报(工学版), 2010, 40(增刊): 262-0265.
[6]	LIU Xue-jie, LIU Yan-heng, LI Mu-shan, Li Yan,Guan Jian. Dynamic resource allocation of extended policy based network management(PBNM) model in mobile environment [J]. 吉林大学学报(工学版), 2010, 40(01): 176-0182.
[7]	MEI Fang，LIU Yan-heng，ZHANG Xu-li，Gu Tian-ye，WANG Wang . Dynamic conflict resolution mechanism for resource management policy in mobile network [J]. 吉林大学学报(工学版), 2009, 39(02): 430-0435.
[8]	YANG Yuequan, JIANG Zemin, XU De, DAI Xianzhong, TAN Min. Modeling and control for systems based on network [J]. 吉林大学学报(工学版), 2004, (3): 439-444.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

Comments

Recommended 0

No Suggested Reading articles found!

参数	服务器节点	普通节点
CPU	Intel 酷睿i9 9900K	AMD Ryzen 5 3500X
RAM	DDR 3200 64GB	DDR 2400 8 GB
SDD	三星970 PRO 512GB NVMe M.2 SSD	西部数据WD GREEN 240 GB M.2 SSD
OS	Windows 10	Windows10

电子商务网站服务器端口编号	网络流量的样本数量	电子商务网站服务器端口编号	网络流量的样本数量
1	20 000	6	20 000
2	25 000	7	30 000
3	25 000	8	30 000
4	50 000	9	40 000
5	20 000	10	50 000

网络流量编号	单步				多步
网络流量编号	m	τ	C	σ	m	τ	C	σ
1	12	11	262.64	12.28	5	7	259.76	18.27
2	10	10	246.50	10.92	5	8	157.05	16.97
3	6	8	167.27	16.44	6	4	131.56	15.28
4	8	5	284.77	11.61	8	11	222.70	11.36
5	10	13	128.22	18.01	12	10	270.01	13.58
6	5	9	284.21	18.63	10	13	201.34	12.89
7	8	8	288.03	14.58	9	3	166.91	18.31
8	5	9	163.04	14.21	9	10	293.41	19.12
9	6	7	130.56	15.44	4	10	115.80	11.08
10	12	11	117.76	10.29	5	6	207.38	16.84

Large scale network traffic prediction based on cloud computing and big data analysis

RICH HTML

PDF (PC)