Multi Attribute D-S Evidence Theory Based OCC for Shared-State Scheduling in Large Scale Cluster
Keywords:large scale cluster scheduling, multi attribute D-S evidence theory, optimistic concurrency control, Shared-state scheduling
With the growth of big data problems, nowadays the size of cloud-scale computing clusters is growing rapidly to run complicated parallel processing jobs. To full utilize cluster resources, the cluster management system is being challenged by the scaling cloud size and the often more complicated application requirements. Omega scheduling software provides a flexible and scalable shared-state scheduling architecture for large scale cluster scheduling. One of its key ideas is using an optimistic concurrency control (OCC) algorithm to let parallel schedulers concurrently make decisions. However, there are few studies exploring to extend OCC for a shared-state scheduling architecture. Furthermore, most of the traditional’ shared-state scheduling architectures also use the same OCCs as Omega does. In this paper, we present a multi attributeDempster–Shafer (D-S) evidence theory based OCC for shared-state scheduling. This OCC adaptsthe multi attribute D-S evidence theory to help making conflict decisions for some scheduling transactions. Experiments’ results show that our method can obtain in some respects more optimized scheduling results compared to coarse-grained conflict detection of Omega.
How to Cite
The submitting author warrants that the submission is original and that she/he is the author of the submission together with the named co-authors; to the extend the submission incorporates text passages, figures, data or other material from the work of others, the submitting author has obtained any necessary permission.
Articles in this journal are published under the Creative Commons Attribution Licence (CC-BY What does this mean?). This is to get more legal certainty about what readers can do with published articles, and thus a wider dissemination and archiving, which in turn makes publishing with this journal more valuable for you, the authors.
By submitting an article the author grants to this journal the non-exclusive right to publish it. The author retains the copyright and the publishing rights for his article without any restrictions.