Journal of Jilin University(Engineering and Technology Edition) ›› 2020, Vol. 50 ›› Issue (1): 247-254.doi: 10.13229/j.cnki.jdxbgxb20181250

Previous Articles    

Dynamic load balancing of physiological data flow in big data network parallel computing environment

Xiao-dong ZHANG1,2(),Xiao-jun XIA1,Hai-feng LYU1,2,Xu-chao GONG3,Meng-jia LIAN1,2   

  1. 1. Shenyang Institute of Computing Technology, Chinese Academy of Science, Shenyang 110168, China
    2. University of Chinese Academy of Sciences, Beijing 100049, China
    3. China University of Petroleum (East China), Qingdao 266580, China
  • Received:2018-12-19 Online:2020-01-01 Published:2020-02-06

RICH HTML

 7   

PDF (PC)

118

Abstract:

In the medical big data service system, there exists the problem of the unbalanced dynamic load of physiological data flow. The processing power of the traditional method is limited to the window range that can be processed by the node where the operator is located. In the state where the data is gradually increased, the processing capacity is insufficient, the data flow congestion is easy to occur, and the load distribution of the whole system is neglected. To solve these problems, a new dynamic load balancing method for physiological data flow based on network parallel computing environment is proposed in this paper. Firstly, the Hash value of the tuple key is used to obtain the corresponding data block of the node, and the corresponding target node is obtained by using the data block record, and the data tuple is output. At the same time, the entropy of parallel computing is extended to define the heterogeneous cluster and solve it. Then, the parallel computing entropy in the network parallel computing environment is regarded as the measurement index of the dynamic load balancing of physiological data flow in the medical big data service system. Finally, by judging whether load migration is necessary by parallel computing entropy, the way and amount of migration tasks are determined by parallel computing entropy, so we can make migration decision and realize dynamic load balancing of physiological data flow in parallel environment of large data network. The experimental results show that the proposed method is highly feasible, and the calculation performance and dynamic load balance are good.

Key words: computer application, big data, network parallel computing, physiological data flow, dynamic, load balancing

CLC Number: 

  • TP399

Table 1

Comparison of calculation performance of three methods"

核数 本文方法 文献[5]方法 文献[6]方法
计算时间/s 加速比 并行效率/% 计算时间/s 加速比 并行效率/% 计算时间/s 加速比 并行效率/%
200 729 1 100 851 1 100 822 1 100
400 395 2.05 96.35 902 0.81 49.21 769 1.08 62.13
600 286 2.71 86.21 953 0.69 24.96 751 1.15 42.3
800 161 2.93 73.05 1 025 0.58 17.21 722 1.31 21.35

Fig.1

Load balancing response spectrum before and after processing by proposed method"

Fig.2

Load change of neighbor nodes by proposed method"

Fig.3

Comparison of average flow of maximum load nodes by three methods"

Fig.4

Changes in load balance by using three methods"

Fig.5

Graph for partial data of experimental data flow"

Fig.6

Time?consuming comparison of three load balancing methods"

1 Omar Alzoubi , Davide Fossati , D'Mello Sidney K , et al . Affect detection from non-stationary physiological data using ensemble classifiers[J]. Evolving Systems，2015，6(2) :310-313.
2 张虹波，匡银虎 . 物联网通信资源负载均衡优化调度仿真研究[J]. 计算机仿真, 2017，34(6)：310-313.
Zhang Hong-bo ， Kuang Yin-hu . Simulation research on load balancing optimization scheduling of communication resources in Internet of Things[J]. Computer Simulation,2017,34(6): 310-313.
3 Hadi Banaee , Amy Loutfi . Data-driven rule mining and representation of temporal patterns in physiological sensor data[J]. IEEE Journal of Biomedical & Health Informatics, 2015，19(5)：1557-1566.
4 孙兰芳,张曦煌 . 基于蜜蜂采蜜机理的云计算负载均衡策略[J]. 计算机应用研究, 2016，33(4)：1179-1182.
Sun Lan-fang , Zhang Xi-huang . Load balancing strategy of cloud computing based on bees hunting honey mechanism[J]. Application Research of Computers, 2016，33(4)：1179-1182.
5 Ghadah Aldabbagh , Bakhsh Sheikh Tahir, Nadine Akkari , et al . Distributed dynamic load balancing in a heterogeneous network using LTE and TV white spaces[J]. Wireless Networks, 2015，21(7)：2413-2424.
6 李梓杨，于炯，卞琛，等 . 基于负载感知的数据流动态负载均衡策略[J]. 计算机应用, 2017，37(10)：2760-2766.
Li Zi-yang ， Yu Jiong ， Bian Chen ，et al . Dynamic data stream load balancing strategy based on load awareness[J]. Journal of Computer Applications, 2017，37(10)：2760-2766.
7 郭正红，马辛华，兰安怡 . 基于层次分析法权重和灰色服务器负载预测的云计算on-line迁移策略[J]. 计算机测量与控制,2015，23(3)：1002-1004.
Guo Zheng-hong ， Ma Xin-hua ， Lan Ai-yi . On-line Migration strategy in cloud computing based on AHP weight and gray server load predicting[J]. Computer Measurement & Control, 2015，23(3)：1002-1004.
8 Micah Adler , Soumen Chakrabarti , Michael Mitzenmacher , et al . Parallel randomized load balancing[J]. Random Structures & Algorithms, 2015，13(2):159-188.
9 Mohammad Alizadeh , Tom Edsall , Sarang Dharmapurikar ，et al . CONGA: distributed congestion-aware load balancing for datacenters[J]. ACM Sigcomm Computer Communication Review, 2015, 44(4):503-514.
10 Mukherjee D , Borst S C , van Leeuwaarden J S H , et al . Universality of load balancing schemes on diffusion scale[J]. Journal of Applied Probability, 2016，53(4)：1111-1124.
11 聂世青，钟勇，崔梦天 . 一种基于负载熵的层次负载均衡算法[J]. 计算机应用,2016，36(增刊.2：33-36.
Nie Shi-qing ， Zhong Yong ， Cui Meng-tian . Hierarchical load balancing algorithm based on load entropy[J]. Journal of Computer Applications，2016，36(Sup.2)：33-36.
12 朱炜,王俊,周迅钊 . 基于负载均衡的医院云计算系统资源调度方案[J]. 计算机工程,2018, 44 (3): 37-41, 54.
Zhu Wei , Wang Jun , Zhou Xun-zhao . Hospital cloud computing system resource scheduling scheme based on load balancing[J]. Computer Engineering,2018, 44 (3): 37-41, 54.
13 全力,傅明 . 云计算中任务调度优化策略的研究[J]. 计算机工程, 2018, 44(8): 14-18.
Quan Li , Fu Ming . Research on task scheduling optimization strategy in cloud computing[J]. Computer Engineering, 2018, 44(8): 14-18.
14 Silva I ， Moody G B . An open-source toolbox for analysing and processing PhysioNet databases in MATLAB and Octave[J]. Journal of Open Research Software, 2014, 2(1):
No .e27.
15 江列霖,杨培中,史超 . 基于负载均衡分区法的建筑火灾并行数值模拟及应用[J]. 上海交通大学学报, 2018，52(11)：1524-1531.
Jiang Lie-lin , Yang Pei-zhong , Shi Chao . Numerical parallel simulation and application of building fire based on load balance domain decomposition method[J]. Journal of Shanghai Jiaotong University，2018，52(11)：1524-1531.
[1] Peng-hui WANG,Hong-xia QIAO,Qiong FENG,Hui CAO,Shao-yong WEN. Durability model of magnesium oxychloride-coated reinforced concrete under the two coupling factors [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(1): 191-201.
[2] Yu-lin CHANG,Cai-hong YUAN,Chao SUN,Peng ZHANG. Calculation method for actual impedance of urban network based on improved cell transmission model [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(1): 132-139.
[3] Kong-hui GUO,Shi-qing HUANG,Hai-dong WU. In⁃plane dynamic tire model for high⁃frequency excitation [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(1): 19-28.
[4] Ying WANG,Ping LI,Teng-fei NIAN,Ji-bin JIANG. Short-term water damage characteristics of asphalt mixture based on dynamic water scour effect [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(1): 174-182.
[5] Xiong-fei LI,Jing WANG,Xiao-li ZHANG,Tie-hu FAN. Multi-focus image fusion based on support vector machines and window gradient [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(1): 227-236.
[6] Xin GUAN,Hao JIN,Chun-guang DUAN,Ping-ping LU. Estimation of lateral slope of vehicle driving road [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 1802-1809.
[7] Yi JIA,Ren-da ZHAO,Yong-bao WANG,Fu-hai LI. Sensitivity analysis of viscous damper parameters for multi⁃span and long⁃unit continuous girder bridges [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 1871-1883.
[8] Fu-chun JIA,Xian-jie MENG,Yu-long LEI. Optimal design of two degrees of freedom dynamic vibration absorber based on multi-objective genetic algorithm [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 1969-1976.
[9] Bing-hai ZHOU,Qiong WU. Balancing and optimization of robotic assemble lines withtool and space constraint [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 2069-2075.
[10] Xiang-jiu CHE,Hua-luo LIU,Qing-bin SHAO. Fabric defect recognition algorithm based onimproved Fast RCNN [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 2038-2044.
[11] Xin CHEN,Xin-jian RUAN,Ming LI,Ning WANG,Jia-ning WANG,Kai-xuan PAN. Application of modified discrete scheme based onlarge eddy simulation [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 1756-1763.
[12] Wei WEI,Xu LIU,Xue-yong HAN,Qing-dong YAN. Flow field reconstruction accuracy influence of proper orthogonal decomposition basis functions in hydrodynamic retarderunder full⁃filled operating condition [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 1959-1968.
[13] You ZHOU,Sen YANG,Da-lin LI,Chun-guo WU,Yan WANG,Kang-ping WANG. Acceleration platform for face detection and recognition based on field⁃programmable gate array [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 2051-2057.
[14] Li XIN,Wei LAN,Jiang LIU,Qin-lin WAN,Peng GUO,Xing-jun HU,Yang XIAO. Simulation and control of pollution on automobile body surface during wading [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 1786-1794.
[15] Hong-wei ZHAO,Peng WANG,Li-li FAN,Huang-shui HU,Ping-ping LIU. Similarity retention instance retrieval method [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 2045-2050.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright © Journal of Jilin University(Engineering and Technology Edition), All Rights Reserved.
Tel: +86-431-85095297　Fax: +86-431-85094074　E-mail: xbgxb@jlu.edu.cn
Powered by Beijing Magtech Co. Ltd