|
|
论文:2017,Vol:35,Issue(1):32-37 |
|
|
引用本文： |
|
|
邓志龙, 付明月, 张琦玮. 基于hadoop的时隙优化任务调度策略研究[J]. 西北工业大学学报 |
|
|
Deng Zhilong, Fu Mingyue, Zhang Qiwei. A Research of Time Slot Optimization Task Scheduling Strategy Based on the Hadoop[J]. Northwestern polytechnical university |
|
|
|
|
|
|
|
| 基于hadoop的时隙优化任务调度策略研究 |
|
| 邓志龙1, 付明月2, 张琦玮2 |
|
1. 西北工业大学 电子信息学院, 陕西 西安 710072;
2. 西北工业大学 自动化学院, 陕西 西安 710072 |
| 摘要: |
| 针对分布式云计算平台hadoop任务调度中由于网络时延而导致的调度不平衡问题，提出一种基于时隙优化的任务调度算法。充分参考当前网络条件，将其作为任务调度的重要参考依据，利用SDN对网络带宽的管理能力，根据时隙策略分配带宽，结合局部性原理决定将任务分派到本地还是低负载的其他节点，从全局角度保证任务本地化比例较高的前提下以最优的方式高效分派任务，以提高系统整体的任务处理能力。依据算法设计调度器设计并进行实验，实验结果验证了算法的调度质量。 |
| 关键词:
云计算
hadoop平台
SDN架构
任务调度
时隙策略
负载均衡
|
|
| A Research of Time Slot Optimization Task Scheduling Strategy Based on the Hadoop |
|
| Deng Zhilong1, Fu Mingyue2, Zhang Qiwei2 |
|
1. School of Electronics and Information, Northwestern Polytechnical University, Xi'an 710072, China;
2. School of Automation, Northwestern Polytechnical University, Xi'an 710072, China |
| Abstract: |
| In this paper, a task scheduling algorithm based on time slot optimization is putted forward to solve the problems of imbalance about the network time delay in scheduling in distributed task scheduling in the cloud computing platform hadoop. Referring to the current network conditions, this algorithm as an important reference in task scheduling. According to the strategy of the time slot to allocate bandwidth and using of SDN management ability of network bandwidth, combined with the principle of locality to task assignment whether in local or other nodes of low load, from the global perspective,ensure higher percentage localization task to task in the high efficiency, in the last, the ability to handle task of system as a whole is improved a lot. According to the algorithm to design the scheduler and experimental testing,the results verify the quality of scheduling algorithm. |
| Key words:
cloud computing
hadoop platform
SDN architecture
task scheduling
time slot strategy
load balancing
|
|
| 收稿日期: 2016-09-01
修回日期:
|
| DOI: |
| 基金项目: 国家自然科学基金（61471299）资助 |
| 通讯作者:
Email： |
| 作者简介: 邓志龙(1976-),西北工业大学博士研究生,主要从事信号处理、数据挖掘等研究。
|
|
|
|
|
|
|
|
参考文献: |
|
|
[1] 李强,郝沁汾,肖利民,等. 云计算中虚拟机放置的自适应管理与多目标优化[J]. 计算机学报, 2011, 34(12):2253-2264 Li Qiang, Hao Qinfen, Xiao Limin, et al. Adaptive Management and Multi-Objective Optimization for Virtual Machine Placement in Cloud Computing[J]. Chinese Journal of Computers, 2011, 34(12):2253-2264(in Chinese)
[2] Xiao Luxin. Research on the Optimization of Enrollment Data Resources Based on Cloud Computing Platform[J]. International Information and Engineering Technology Association, 2015, 2(2):9-12
[3] Hu L, Jin H, Liao X, et al. Magnet:A Novel Scheduling Policy for Power Reduction in Cluster with Virtual Machines[C]//2008 IEEE International Conference on Cluster Computing, 2008:13-22
[4] Narayan S, Bailey S, Greenway M, et al. Openflow Enabled hadoop over Local and Wide Area Clusters[C]//2012 SC Companion:High Performance Computing, Networking, Storage and Analysis (SCC), Salt Lake City, Utah, USA, 2012:1625-1628
[5] Narayan S, Bailey S, Daga A. Hadoop Acceleration in an Openflow-Based Cluster[C]//2012 SC Companion:High Performance Computing, Networking, Storage and Analysis (SCC), Salt Lake City, Utah, USA, 2012:535-538
[6] Anceaume Emmanuelle, Défago Xavier, Gradinariu Maria, Roy Matthieu. Towards a Theory of Self-Organization[J]. Lecture Notes in Computer Science, LNCS, 2006, 3974:191-205
[7] Aroca Jordi Arjona, Fernández Anta Antonio, Mosteiro Miguel A, Thraves Christopher, Wang Lin. Power-Efficient Assignment of Virtual Machines to Physical Machines[J]. Future Generation Computer Systems, 2016, 54:82-94
[8] Sheikhalishahi Mehdi, Wallace Richard M, Grandinetti Lucio, et al. A Multi-Dimensional Job Scheduling[J]. Future Generation Computer Systems, 2016, 54:123-131 |
|
|
|
相关文献: |
|
|
1．邓志龙, 段哲民, 李刘涛.OpenStack环境下的资源动态调度研究[J]. 西北工业大学学报, 2016,34(4): 650-655 |
|
|
|
|
|
|
