Resource provisioning for data-intensive applications with deadline constraints on hybrid clouds using Aneka

Adel Nadjaran Toosi, Richard O. Sinnott, Rajkumar Buyya

Research output: Contribution to journalArticleResearchpeer-review

Abstract

Cloud computing has emerged as a mainstream paradigm for hosting various types of applications by supporting easy-to-use computing services. Among the many different forms of cloud computing, hybrid clouds, which mix on-premises private cloud and third-party public cloud services to deploy applications, have gained broad acceptance. They are particularly relevant for applications requiring large volumes of computing power exceeding the computational capacity within the premises of a single organization. However, the use of hybrid clouds introduces the challenge of how much and when public cloud resources should be added to the pool of resources – and especially when it is necessary to support quality of service requirements of applications with deadline constraints. These resource provisioning decisions are far from trivial if scheduling involves data-intensive applications using voluminous amounts of data. Issues such as the impact of network latency, bandwidth constraints, and location of data must be taken into account in order to minimize the execution cost while meeting the deadline for such applications. In this paper, we propose a new resource provisioning algorithm to support the deadline requirements of data-intensive applications in hybrid cloud environments. To evaluate our proposed algorithm, we implement it in Aneka, a platform for developing scalable applications on the Cloud. Experimental results using a real case study executing a data-intensive application to measure the walkability index on a hybrid cloud platform consisting of dynamic resources from the Microsoft Azure cloud show that our proposed provisioning algorithm is able to more efficiently allocate resources compared to existing methods.

LanguageEnglish
Pages765-775
Number of pages11
JournalFuture Generation Computer Systems
Volume79
DOIs
Publication statusPublished - 1 Feb 2018
Externally publishedYes

Keywords

  • Aneka cloud application platform
  • Data locality
  • Data-intensive applications
  • Deadline-driven scheduling
  • Dynamic provisioning
  • Hybrid cloud
  • Network bandwidth

Cite this

@article{16d8c05e7e8745f9985be91cbeac00fc,
title = "Resource provisioning for data-intensive applications with deadline constraints on hybrid clouds using Aneka",
abstract = "Cloud computing has emerged as a mainstream paradigm for hosting various types of applications by supporting easy-to-use computing services. Among the many different forms of cloud computing, hybrid clouds, which mix on-premises private cloud and third-party public cloud services to deploy applications, have gained broad acceptance. They are particularly relevant for applications requiring large volumes of computing power exceeding the computational capacity within the premises of a single organization. However, the use of hybrid clouds introduces the challenge of how much and when public cloud resources should be added to the pool of resources – and especially when it is necessary to support quality of service requirements of applications with deadline constraints. These resource provisioning decisions are far from trivial if scheduling involves data-intensive applications using voluminous amounts of data. Issues such as the impact of network latency, bandwidth constraints, and location of data must be taken into account in order to minimize the execution cost while meeting the deadline for such applications. In this paper, we propose a new resource provisioning algorithm to support the deadline requirements of data-intensive applications in hybrid cloud environments. To evaluate our proposed algorithm, we implement it in Aneka, a platform for developing scalable applications on the Cloud. Experimental results using a real case study executing a data-intensive application to measure the walkability index on a hybrid cloud platform consisting of dynamic resources from the Microsoft Azure cloud show that our proposed provisioning algorithm is able to more efficiently allocate resources compared to existing methods.",
keywords = "Aneka cloud application platform, Data locality, Data-intensive applications, Deadline-driven scheduling, Dynamic provisioning, Hybrid cloud, Network bandwidth",
author = "{Nadjaran Toosi}, Adel and Sinnott, {Richard O.} and Rajkumar Buyya",
year = "2018",
month = "2",
day = "1",
doi = "10.1016/j.future.2017.05.042",
language = "English",
volume = "79",
pages = "765--775",
journal = "Future Generation Computer Systems",
issn = "0167-739X",
publisher = "Elsevier",

}

Resource provisioning for data-intensive applications with deadline constraints on hybrid clouds using Aneka. / Nadjaran Toosi, Adel; Sinnott, Richard O.; Buyya, Rajkumar.

In: Future Generation Computer Systems, Vol. 79, 01.02.2018, p. 765-775.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Resource provisioning for data-intensive applications with deadline constraints on hybrid clouds using Aneka

AU - Nadjaran Toosi, Adel

AU - Sinnott, Richard O.

AU - Buyya, Rajkumar

PY - 2018/2/1

Y1 - 2018/2/1

N2 - Cloud computing has emerged as a mainstream paradigm for hosting various types of applications by supporting easy-to-use computing services. Among the many different forms of cloud computing, hybrid clouds, which mix on-premises private cloud and third-party public cloud services to deploy applications, have gained broad acceptance. They are particularly relevant for applications requiring large volumes of computing power exceeding the computational capacity within the premises of a single organization. However, the use of hybrid clouds introduces the challenge of how much and when public cloud resources should be added to the pool of resources – and especially when it is necessary to support quality of service requirements of applications with deadline constraints. These resource provisioning decisions are far from trivial if scheduling involves data-intensive applications using voluminous amounts of data. Issues such as the impact of network latency, bandwidth constraints, and location of data must be taken into account in order to minimize the execution cost while meeting the deadline for such applications. In this paper, we propose a new resource provisioning algorithm to support the deadline requirements of data-intensive applications in hybrid cloud environments. To evaluate our proposed algorithm, we implement it in Aneka, a platform for developing scalable applications on the Cloud. Experimental results using a real case study executing a data-intensive application to measure the walkability index on a hybrid cloud platform consisting of dynamic resources from the Microsoft Azure cloud show that our proposed provisioning algorithm is able to more efficiently allocate resources compared to existing methods.

AB - Cloud computing has emerged as a mainstream paradigm for hosting various types of applications by supporting easy-to-use computing services. Among the many different forms of cloud computing, hybrid clouds, which mix on-premises private cloud and third-party public cloud services to deploy applications, have gained broad acceptance. They are particularly relevant for applications requiring large volumes of computing power exceeding the computational capacity within the premises of a single organization. However, the use of hybrid clouds introduces the challenge of how much and when public cloud resources should be added to the pool of resources – and especially when it is necessary to support quality of service requirements of applications with deadline constraints. These resource provisioning decisions are far from trivial if scheduling involves data-intensive applications using voluminous amounts of data. Issues such as the impact of network latency, bandwidth constraints, and location of data must be taken into account in order to minimize the execution cost while meeting the deadline for such applications. In this paper, we propose a new resource provisioning algorithm to support the deadline requirements of data-intensive applications in hybrid cloud environments. To evaluate our proposed algorithm, we implement it in Aneka, a platform for developing scalable applications on the Cloud. Experimental results using a real case study executing a data-intensive application to measure the walkability index on a hybrid cloud platform consisting of dynamic resources from the Microsoft Azure cloud show that our proposed provisioning algorithm is able to more efficiently allocate resources compared to existing methods.

KW - Aneka cloud application platform

KW - Data locality

KW - Data-intensive applications

KW - Deadline-driven scheduling

KW - Dynamic provisioning

KW - Hybrid cloud

KW - Network bandwidth

UR - http://www.scopus.com/inward/record.url?scp=85023609419&partnerID=8YFLogxK

U2 - 10.1016/j.future.2017.05.042

DO - 10.1016/j.future.2017.05.042

M3 - Article

VL - 79

SP - 765

EP - 775

JO - Future Generation Computer Systems

T2 - Future Generation Computer Systems

JF - Future Generation Computer Systems

SN - 0167-739X

ER -