Cost-efficient orchestration of containers in clouds: a vision, architectural elements, and future directions

Rajkumar Buyya, Maria A. Rodriguez, Adel Nadjaran Toosi, Jaeman Park

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearch

Abstract

This paper proposes an architectural framework for the efficient orchestration of containers in cloud environments. It centres around resource scheduling and rescheduling policies as well as autoscaling algorithms that enable the creation of elastic virtual clusters. In this way, the proposed framework enables the sharing of a computing environment between differing client applications packaged in containers, including web services, offline analytics jobs, and backend pre-processing tasks. The devised resource management algorithms and policies will improve utilization of the available virtual resources to reduce operational cost for the provider while satisfying the resource needs of various types of applications. The proposed algorithms will take factors that are previously omitted by other solutions into consideration, including 1) the pricing models of the acquired resources, 2) and the fault-tolerability of the applications, and 3) the QoS requirements of the running applications, such as the latencies and throughputs of the web services and the deadline of the analytical and pre-processing jobs. The proposed solutions will be evaluated by developing a prototype platform based on one of the existing container orchestration platforms.

Original languageEnglish
Title of host publication2nd Mathematics, Informatics, Science and Education International Conference (MISEIC) 2018
Subtitle of host publication21 July 2018, Surabaya, Indonesia
EditorsYuni Sri Rahayu, Rooselyna Ekawati, Nadi Suprapto, Eng Asep Bayu Dani Nandiyanto, Setya Chendra Wibawa, Shofan Fiangga, M. Jakfar
Place of PublicationBristol ENG
PublisherIOS Press
Number of pages13
DOIs
Publication statusPublished - 2018
EventMathematics, Informatics, Science and Education International Conference 2018 - Surabaya, Indonesia
Duration: 21 Jul 201821 Jul 2018
Conference number: 2nd
https://web.archive.org/web/20180419105001/http://conference.unesa.ac.id/conference/miseic/

Publication series

NameJournal of Physics: Conference Series
PublisherIOP Publishing
Volume1108
ISSN (Print)1742-6588

Conference

ConferenceMathematics, Informatics, Science and Education International Conference 2018
Abbreviated titleMISEIC 2018
CountryIndonesia
CitySurabaya
Period21/07/1821/07/18
Internet address

Cite this

Buyya, R., Rodriguez, M. A., Toosi, A. N., & Park, J. (2018). Cost-efficient orchestration of containers in clouds: a vision, architectural elements, and future directions. In Y. Sri Rahayu, R. Ekawati, N. Suprapto, E. Asep Bayu Dani Nandiyanto, S. Chendra Wibawa, S. Fiangga, & M. Jakfar (Eds.), 2nd Mathematics, Informatics, Science and Education International Conference (MISEIC) 2018: 21 July 2018, Surabaya, Indonesia (Journal of Physics: Conference Series; Vol. 1108). Bristol ENG: IOS Press. https://doi.org/10.1088/1742-6596/1108/1/012001
Buyya, Rajkumar ; Rodriguez, Maria A. ; Toosi, Adel Nadjaran ; Park, Jaeman. / Cost-efficient orchestration of containers in clouds : a vision, architectural elements, and future directions. 2nd Mathematics, Informatics, Science and Education International Conference (MISEIC) 2018: 21 July 2018, Surabaya, Indonesia. editor / Yuni Sri Rahayu ; Rooselyna Ekawati ; Nadi Suprapto ; Eng Asep Bayu Dani Nandiyanto ; Setya Chendra Wibawa ; Shofan Fiangga ; M. Jakfar. Bristol ENG : IOS Press, 2018. (Journal of Physics: Conference Series).
@inproceedings{adbf5b7ccabd42b58e218d0ec397017a,
title = "Cost-efficient orchestration of containers in clouds: a vision, architectural elements, and future directions",
abstract = "This paper proposes an architectural framework for the efficient orchestration of containers in cloud environments. It centres around resource scheduling and rescheduling policies as well as autoscaling algorithms that enable the creation of elastic virtual clusters. In this way, the proposed framework enables the sharing of a computing environment between differing client applications packaged in containers, including web services, offline analytics jobs, and backend pre-processing tasks. The devised resource management algorithms and policies will improve utilization of the available virtual resources to reduce operational cost for the provider while satisfying the resource needs of various types of applications. The proposed algorithms will take factors that are previously omitted by other solutions into consideration, including 1) the pricing models of the acquired resources, 2) and the fault-tolerability of the applications, and 3) the QoS requirements of the running applications, such as the latencies and throughputs of the web services and the deadline of the analytical and pre-processing jobs. The proposed solutions will be evaluated by developing a prototype platform based on one of the existing container orchestration platforms.",
author = "Rajkumar Buyya and Rodriguez, {Maria A.} and Toosi, {Adel Nadjaran} and Jaeman Park",
year = "2018",
doi = "10.1088/1742-6596/1108/1/012001",
language = "English",
series = "Journal of Physics: Conference Series",
publisher = "IOS Press",
editor = "{Sri Rahayu}, {Yuni } and Ekawati, {Rooselyna } and Suprapto, {Nadi } and {Asep Bayu Dani Nandiyanto}, Eng and {Chendra Wibawa}, {Setya } and Fiangga, {Shofan } and Jakfar, {M. }",
booktitle = "2nd Mathematics, Informatics, Science and Education International Conference (MISEIC) 2018",
address = "Netherlands",

}

Buyya, R, Rodriguez, MA, Toosi, AN & Park, J 2018, Cost-efficient orchestration of containers in clouds: a vision, architectural elements, and future directions. in Y Sri Rahayu, R Ekawati, N Suprapto, E Asep Bayu Dani Nandiyanto, S Chendra Wibawa, S Fiangga & M Jakfar (eds), 2nd Mathematics, Informatics, Science and Education International Conference (MISEIC) 2018: 21 July 2018, Surabaya, Indonesia. Journal of Physics: Conference Series, vol. 1108, IOS Press, Bristol ENG, Mathematics, Informatics, Science and Education International Conference 2018, Surabaya, Indonesia, 21/07/18. https://doi.org/10.1088/1742-6596/1108/1/012001

Cost-efficient orchestration of containers in clouds : a vision, architectural elements, and future directions. / Buyya, Rajkumar; Rodriguez, Maria A.; Toosi, Adel Nadjaran; Park, Jaeman.

2nd Mathematics, Informatics, Science and Education International Conference (MISEIC) 2018: 21 July 2018, Surabaya, Indonesia. ed. / Yuni Sri Rahayu; Rooselyna Ekawati; Nadi Suprapto; Eng Asep Bayu Dani Nandiyanto; Setya Chendra Wibawa; Shofan Fiangga; M. Jakfar. Bristol ENG : IOS Press, 2018. (Journal of Physics: Conference Series; Vol. 1108).

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearch

TY - GEN

T1 - Cost-efficient orchestration of containers in clouds

T2 - a vision, architectural elements, and future directions

AU - Buyya, Rajkumar

AU - Rodriguez, Maria A.

AU - Toosi, Adel Nadjaran

AU - Park, Jaeman

PY - 2018

Y1 - 2018

N2 - This paper proposes an architectural framework for the efficient orchestration of containers in cloud environments. It centres around resource scheduling and rescheduling policies as well as autoscaling algorithms that enable the creation of elastic virtual clusters. In this way, the proposed framework enables the sharing of a computing environment between differing client applications packaged in containers, including web services, offline analytics jobs, and backend pre-processing tasks. The devised resource management algorithms and policies will improve utilization of the available virtual resources to reduce operational cost for the provider while satisfying the resource needs of various types of applications. The proposed algorithms will take factors that are previously omitted by other solutions into consideration, including 1) the pricing models of the acquired resources, 2) and the fault-tolerability of the applications, and 3) the QoS requirements of the running applications, such as the latencies and throughputs of the web services and the deadline of the analytical and pre-processing jobs. The proposed solutions will be evaluated by developing a prototype platform based on one of the existing container orchestration platforms.

AB - This paper proposes an architectural framework for the efficient orchestration of containers in cloud environments. It centres around resource scheduling and rescheduling policies as well as autoscaling algorithms that enable the creation of elastic virtual clusters. In this way, the proposed framework enables the sharing of a computing environment between differing client applications packaged in containers, including web services, offline analytics jobs, and backend pre-processing tasks. The devised resource management algorithms and policies will improve utilization of the available virtual resources to reduce operational cost for the provider while satisfying the resource needs of various types of applications. The proposed algorithms will take factors that are previously omitted by other solutions into consideration, including 1) the pricing models of the acquired resources, 2) and the fault-tolerability of the applications, and 3) the QoS requirements of the running applications, such as the latencies and throughputs of the web services and the deadline of the analytical and pre-processing jobs. The proposed solutions will be evaluated by developing a prototype platform based on one of the existing container orchestration platforms.

UR - http://www.scopus.com/inward/record.url?scp=85058286462&partnerID=8YFLogxK

U2 - 10.1088/1742-6596/1108/1/012001

DO - 10.1088/1742-6596/1108/1/012001

M3 - Conference Paper

T3 - Journal of Physics: Conference Series

BT - 2nd Mathematics, Informatics, Science and Education International Conference (MISEIC) 2018

A2 - Sri Rahayu, Yuni

A2 - Ekawati, Rooselyna

A2 - Suprapto, Nadi

A2 - Asep Bayu Dani Nandiyanto, Eng

A2 - Chendra Wibawa, Setya

A2 - Fiangga, Shofan

A2 - Jakfar, M.

PB - IOS Press

CY - Bristol ENG

ER -

Buyya R, Rodriguez MA, Toosi AN, Park J. Cost-efficient orchestration of containers in clouds: a vision, architectural elements, and future directions. In Sri Rahayu Y, Ekawati R, Suprapto N, Asep Bayu Dani Nandiyanto E, Chendra Wibawa S, Fiangga S, Jakfar M, editors, 2nd Mathematics, Informatics, Science and Education International Conference (MISEIC) 2018: 21 July 2018, Surabaya, Indonesia. Bristol ENG: IOS Press. 2018. (Journal of Physics: Conference Series). https://doi.org/10.1088/1742-6596/1108/1/012001