Multi Attribute D-S Evidence Theory Based OCC for Shared-State Scheduling in Large Scale Cluster

Authors

  • Libo He School of Information Science and Engineering of Yunnan University, Kunming City, China
  • Zhenping Qiang
  • Wei Zhou
  • Shaowen Yao

DOI:

https://doi.org/10.3991/ijoe.v12i12.6457

Keywords:

large scale cluster scheduling, multi attribute D-S evidence theory, optimistic concurrency control, Shared-state scheduling

Abstract


With the growth of big data problems, nowadays the size of cloud-scale computing clusters is growing rapidly to run complicated parallel processing jobs. To full utilize cluster resources, the cluster management system is being challenged by the scaling cloud size and the often more complicated application requirements. Omega scheduling software provides a flexible and scalable shared-state scheduling architecture for large scale cluster scheduling. One of its key ideas is using an optimistic concurrency control (OCC) algorithm to let parallel schedulers concurrently make decisions. However, there are few studies exploring to extend OCC for a shared-state scheduling architecture. Furthermore, most of the traditional’ shared-state scheduling architectures also use the same OCCs as Omega does. In this paper, we present a multi attributeDempster–Shafer (D-S) evidence theory based OCC for shared-state scheduling. This OCC adaptsthe multi attribute D-S evidence theory to help making conflict decisions for some scheduling transactions. Experiments’ results show that our method can obtain in some respects more optimized scheduling results compared to coarse-grained conflict detection of Omega.

Downloads

Published

2016-12-25

How to Cite

He, L., Qiang, Z., Zhou, W., & Yao, S. (2016). Multi Attribute D-S Evidence Theory Based OCC for Shared-State Scheduling in Large Scale Cluster. International Journal of Online and Biomedical Engineering (iJOE), 12(12), pp. 43–48. https://doi.org/10.3991/ijoe.v12i12.6457

Issue

Section

Papers