A deadline constrained preemptive scheduler using queuing systems for multi-tenancy clouds

Ru Jia, Yun Yang, John Grundy, Jacky Keung, Hao Li

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

4 Citations (Scopus)


Scheduling on clouds is required so that service providers can meet Quality of Service (QoS) requirements of tenants. Deadline is a major criterion in judging QoS. This work presents a real-time, preemptive, constrained scheduler using queuing theory-PDSonQueue-which enables better meetinhg of QoS requirements. PDSonQueue also shortens a job's completion time and improves system's throughput. PDSon-Queue, as a dynamic priority real-time greedy scheduler, builds a queuing-based mathematical model to accurately predict a job's execution and waiting time, where jobs arrive by following a stochastic process and request resources. Our scheduler introduces a novel 'Earliest Maximal Waiting Time First (EMWTF)' concept to fine tune job scheduling to guarantee the job being accomplished within the deadline. Deadline constrained jobs are scheduled preemptively from low priority jobs with the intent of maximising the number of jobs completed within the deadlines, while allowing system's resources to be shared by other regular jobs. PDSonQueue integrates an improved Dominant Resource Fairness (DRF) greedy resource allocation approach to capture the essence of tenants' resource allocation and run as many jobs as possible. Our experimental results indicate that PDSonQueue can improve by at least 20% of deadline-based QoS rate, and by at least 30% for throughput.

Original languageEnglish
Title of host publicationProceedings - 2019 IEEE International Conference on Cloud Computing - IEEE CLOUD 2019 - Part of the 2019 IEEE World Congress on Services
EditorsElisa Bertino, Carl K. Chang, Peter Chen, Ernesto Damiani, Michael Goul, Katsunori Oyama
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages5
ISBN (Electronic)9781728127057, 9781728127040
ISBN (Print)9781728127064
Publication statusPublished - 2019
EventIEEE International Conference on Cloud Computing 2019 - Milan, Italy
Duration: 8 Jul 201913 Jul 2019
Conference number: 12th
https://ieeexplore.ieee.org/xpl/conhome/8798376/proceeding (Proceedings)


ConferenceIEEE International Conference on Cloud Computing 2019
Abbreviated titleCLOUD 2019
Internet address


  • Deadline
  • Multi-tenancy
  • Queuing Theory
  • Resource preemption
  • Scheduling

Cite this