Mind the gap - a distributed framework for enabling energy optimisation on modern smart-phones in the presence of noise, drift, and statistical insignificance

Mahmoud A. Bokhari; Lujun Weng; Markus Wagner; Bradley Alexander

doi:10.1109/CEC.2019.8790246

Mind the gap - a distributed framework for enabling energy optimisation on modern smart-phones in the presence of noise, drift, and statistical insignificance

Mahmoud A. Bokhari, Lujun Weng, Markus Wagner, Bradley Alexander

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

10 Citations (Scopus)

Abstract

Smartphones are becoming essential to people's everyday lives. Due to the limited battery capacity of smartphones, researchers and developers are increasingly interested in the energy efficiency of these devices and the software applications that run on them. In the most basic setting, a developer might be interested in knowing which of two program variants might consume more energy, whether this is for use in regression testing or for use in full-scale evolutionary optimisation. To perform such comparisons (tournaments) reliably, we need a model of the number of trials needed to discern between two variants to a desired level of statistical significance. To enable this, we present a conceptual framework based on tournaments which we use to compare a range of test workloads on different combinations of phones and operating systems. Our results quantify the number of trials required to resolve different variants to different levels of fidelity on a range of platforms.

Original language	English
Title of host publication	2019 IEEE Congress on Evolutionary Computation, CEC 2019 - Proceedings
Editors	Mengjie Zhang, Kay Chen Tan
Place of Publication	Piscataway NJ USA
Publisher	IEEE, Institute of Electrical and Electronics Engineers
Pages	1330-1337
Number of pages	8
ISBN (Electronic)	9781728121536, 9781728121529
ISBN (Print)	9781728121543
DOIs	https://doi.org/10.1109/CEC.2019.8790246
Publication status	Published - 2019
Externally published	Yes
Event	IEEE Congress on Evolutionary Computation 2019 - Wellington, New Zealand Duration: 10 Jun 2019 → 13 Jun 2019 http://cec2019.org/ https://ieeexplore.ieee.org/xpl/conhome/8778428/proceeding (Proceedings)

Conference

Conference	IEEE Congress on Evolutionary Computation 2019
Abbreviated title	IEEE CEC 2019
Country/Territory	New Zealand
City	Wellington
Period	10/06/19 → 13/06/19
Internet address	http://cec2019.org/ https://ieeexplore.ieee.org/xpl/conhome/8778428/proceeding (Proceedings)

Keywords

energy consumption
nonfunctional properties
Smart phones
tournaments

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1109/CEC.2019.8790246

Cite this

Bokhari, M. A., Weng, L., Wagner, M., & Alexander, B. (2019). Mind the gap - a distributed framework for enabling energy optimisation on modern smart-phones in the presence of noise, drift, and statistical insignificance. In M. Zhang, & K. Chen Tan (Eds.), 2019 IEEE Congress on Evolutionary Computation, CEC 2019 - Proceedings (pp. 1330-1337). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/CEC.2019.8790246

Bokhari, Mahmoud A. ; Weng, Lujun ; Wagner, Markus et al. / Mind the gap - a distributed framework for enabling energy optimisation on modern smart-phones in the presence of noise, drift, and statistical insignificance. 2019 IEEE Congress on Evolutionary Computation, CEC 2019 - Proceedings. editor / Mengjie Zhang ; Kay Chen Tan. Piscataway NJ USA : IEEE, Institute of Electrical and Electronics Engineers, 2019. pp. 1330-1337

@inproceedings{698ca6d68b534cc79c6ba6fb7968eb93,

title = "Mind the gap - a distributed framework for enabling energy optimisation on modern smart-phones in the presence of noise, drift, and statistical insignificance",

abstract = "Smartphones are becoming essential to people's everyday lives. Due to the limited battery capacity of smartphones, researchers and developers are increasingly interested in the energy efficiency of these devices and the software applications that run on them. In the most basic setting, a developer might be interested in knowing which of two program variants might consume more energy, whether this is for use in regression testing or for use in full-scale evolutionary optimisation. To perform such comparisons (tournaments) reliably, we need a model of the number of trials needed to discern between two variants to a desired level of statistical significance. To enable this, we present a conceptual framework based on tournaments which we use to compare a range of test workloads on different combinations of phones and operating systems. Our results quantify the number of trials required to resolve different variants to different levels of fidelity on a range of platforms.",

keywords = "energy consumption, nonfunctional properties, Smart phones, tournaments",

author = "Bokhari, {Mahmoud A.} and Lujun Weng and Markus Wagner and Bradley Alexander",

note = "Publisher Copyright: {\textcopyright} 2019 IEEE.; IEEE Congress on Evolutionary Computation 2019, IEEE CEC 2019 ; Conference date: 10-06-2019 Through 13-06-2019",

year = "2019",

doi = "10.1109/CEC.2019.8790246",

language = "English",

isbn = "9781728121543",

pages = "1330--1337",

editor = "Mengjie Zhang and {Chen Tan}, Kay",

booktitle = "2019 IEEE Congress on Evolutionary Computation, CEC 2019 - Proceedings",

publisher = "IEEE, Institute of Electrical and Electronics Engineers",

address = "United States of America",

url = "http://cec2019.org/, https://ieeexplore.ieee.org/xpl/conhome/8778428/proceeding",

}

Bokhari, MA, Weng, L, Wagner, M & Alexander, B 2019, Mind the gap - a distributed framework for enabling energy optimisation on modern smart-phones in the presence of noise, drift, and statistical insignificance. in M Zhang & K Chen Tan (eds), 2019 IEEE Congress on Evolutionary Computation, CEC 2019 - Proceedings. IEEE, Institute of Electrical and Electronics Engineers, Piscataway NJ USA, pp. 1330-1337, IEEE Congress on Evolutionary Computation 2019, Wellington, New Zealand, 10/06/19. https://doi.org/10.1109/CEC.2019.8790246

Mind the gap - a distributed framework for enabling energy optimisation on modern smart-phones in the presence of noise, drift, and statistical insignificance. / Bokhari, Mahmoud A.; Weng, Lujun; Wagner, Markus et al.
2019 IEEE Congress on Evolutionary Computation, CEC 2019 - Proceedings. ed. / Mengjie Zhang; Kay Chen Tan. Piscataway NJ USA: IEEE, Institute of Electrical and Electronics Engineers, 2019. p. 1330-1337.

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

TY - GEN

T1 - Mind the gap - a distributed framework for enabling energy optimisation on modern smart-phones in the presence of noise, drift, and statistical insignificance

AU - Bokhari, Mahmoud A.

AU - Weng, Lujun

AU - Wagner, Markus

AU - Alexander, Bradley

PY - 2019

Y1 - 2019

N2 - Smartphones are becoming essential to people's everyday lives. Due to the limited battery capacity of smartphones, researchers and developers are increasingly interested in the energy efficiency of these devices and the software applications that run on them. In the most basic setting, a developer might be interested in knowing which of two program variants might consume more energy, whether this is for use in regression testing or for use in full-scale evolutionary optimisation. To perform such comparisons (tournaments) reliably, we need a model of the number of trials needed to discern between two variants to a desired level of statistical significance. To enable this, we present a conceptual framework based on tournaments which we use to compare a range of test workloads on different combinations of phones and operating systems. Our results quantify the number of trials required to resolve different variants to different levels of fidelity on a range of platforms.

AB - Smartphones are becoming essential to people's everyday lives. Due to the limited battery capacity of smartphones, researchers and developers are increasingly interested in the energy efficiency of these devices and the software applications that run on them. In the most basic setting, a developer might be interested in knowing which of two program variants might consume more energy, whether this is for use in regression testing or for use in full-scale evolutionary optimisation. To perform such comparisons (tournaments) reliably, we need a model of the number of trials needed to discern between two variants to a desired level of statistical significance. To enable this, we present a conceptual framework based on tournaments which we use to compare a range of test workloads on different combinations of phones and operating systems. Our results quantify the number of trials required to resolve different variants to different levels of fidelity on a range of platforms.

KW - energy consumption

KW - nonfunctional properties

KW - Smart phones

KW - tournaments

UR - http://www.scopus.com/inward/record.url?scp=85071311320&partnerID=8YFLogxK

U2 - 10.1109/CEC.2019.8790246

DO - 10.1109/CEC.2019.8790246

M3 - Conference Paper

AN - SCOPUS:85071311320

SN - 9781728121543

SP - 1330

EP - 1337

BT - 2019 IEEE Congress on Evolutionary Computation, CEC 2019 - Proceedings

A2 - Zhang, Mengjie

A2 - Chen Tan, Kay

PB - IEEE, Institute of Electrical and Electronics Engineers

CY - Piscataway NJ USA

T2 - IEEE Congress on Evolutionary Computation 2019

Y2 - 10 June 2019 through 13 June 2019

ER -

Bokhari MA, Weng L, Wagner M, Alexander B. Mind the gap - a distributed framework for enabling energy optimisation on modern smart-phones in the presence of noise, drift, and statistical insignificance. In Zhang M, Chen Tan K, editors, 2019 IEEE Congress on Evolutionary Computation, CEC 2019 - Proceedings. Piscataway NJ USA: IEEE, Institute of Electrical and Electronics Engineers. 2019. p. 1330-1337 doi: 10.1109/CEC.2019.8790246

Mind the gap - a distributed framework for enabling energy optimisation on modern smart-phones in the presence of noise, drift, and statistical insignificance

Abstract

Conference

Keywords

UN SDGs

Access to Document

Other files and links

Cite this