刘琨, 肖琳, 赵海燕. Hadoop中云数据负载均衡算法的研究及优化[J]. 微电子学与计算机, 2012, 29(9): 18-22.
引用本文: 刘琨, 肖琳, 赵海燕. Hadoop中云数据负载均衡算法的研究及优化[J]. 微电子学与计算机, 2012, 29(9): 18-22.
LIU Kun, XIAO Lin, ZHAO Hai-yan. Research and Optimize of Cloud Data Load Balancing in Hadoop[J]. Microelectronics & Computer, 2012, 29(9): 18-22.
Citation: LIU Kun, XIAO Lin, ZHAO Hai-yan. Research and Optimize of Cloud Data Load Balancing in Hadoop[J]. Microelectronics & Computer, 2012, 29(9): 18-22.

Hadoop中云数据负载均衡算法的研究及优化

Research and Optimize of Cloud Data Load Balancing in Hadoop

  • 摘要: 介绍了Hadoop的数据负载均衡算法.为了提升Hadoop数据负载均衡算法的效率,文中提出了超负载机架的优先处理及引用排序策略的解决负载均衡的改进算法.实验证明了改进算法在特定的环境下或能够在较短的时间内使各个机架的数据负载达到平衡以及能够优先处理负载超大节点.

     

    Abstract: This paper describes the data load balancing algorithm of Hadoop.In order to improve the efficiency of algorithm, we propose the optimization algorithms using sorting method or handling the overloading racks preferentially to solve load balancing.Experiments show the racks used optimization algorithm can realize load balancing in shorter time or handle the overloading nodes preferentially in certain circumstance.

     

/

返回文章
返回