Automated testing of Android apps: a systematic literature review

Pingfan Kong, Li Li, Jun Gao, Kui Liu, Tegawende F. Bissyande, Jacques Klein

Research output: Contribution to journalArticleResearchpeer-review

Abstract

Automated testing of Android apps is essential for app users, app developers, and market maintainer communities alike. Given the widespread adoption of Android and the specificities of its development model, the literature has proposed various testing approaches for ensuring that not only functional requirements but also nonfunctional requirements are satisfied. In this paper, we aim at providing a clear overview of the state-of-the-art works around the topic of Android app testing, in an attempt to highlight the main trends, pinpoint the main methodologies applied, and enumerate the challenges faced by the Android testing approaches as well as the directions where the community effort is still needed. To this end, we conduct a systematic literature review during which we eventually identified 103 relevant research papers published in leading conferences and journals until 2016. Our thorough examination of the relevant literature has led to several findings and highlighted the challenges that Android testing researchers should strive to address in the future. After that, we further propose a few concrete research directions where testing approaches are needed to solve recurrent issues in app updates, continuous increases of app sizes, as well as the Android ecosystem fragmentation.

Original languageEnglish
Pages (from-to)45-66
Number of pages22
JournalIEEE Transactions on Reliability
Volume68
Issue number1
DOIs
Publication statusPublished - Mar 2019

Keywords

  • Android
  • Androids
  • automated testing
  • Bibliographies
  • Ecosystems
  • Humanoid robots
  • Java
  • literature review
  • survey
  • Systematics
  • Testing

Cite this

Kong, Pingfan ; Li, Li ; Gao, Jun ; Liu, Kui ; Bissyande, Tegawende F. ; Klein, Jacques. / Automated testing of Android apps : a systematic literature review. In: IEEE Transactions on Reliability. 2019 ; Vol. 68, No. 1. pp. 45-66.
@article{ff9c7266b5734d9b8c5721125021a8b4,
title = "Automated testing of Android apps: a systematic literature review",
abstract = "Automated testing of Android apps is essential for app users, app developers, and market maintainer communities alike. Given the widespread adoption of Android and the specificities of its development model, the literature has proposed various testing approaches for ensuring that not only functional requirements but also nonfunctional requirements are satisfied. In this paper, we aim at providing a clear overview of the state-of-the-art works around the topic of Android app testing, in an attempt to highlight the main trends, pinpoint the main methodologies applied, and enumerate the challenges faced by the Android testing approaches as well as the directions where the community effort is still needed. To this end, we conduct a systematic literature review during which we eventually identified 103 relevant research papers published in leading conferences and journals until 2016. Our thorough examination of the relevant literature has led to several findings and highlighted the challenges that Android testing researchers should strive to address in the future. After that, we further propose a few concrete research directions where testing approaches are needed to solve recurrent issues in app updates, continuous increases of app sizes, as well as the Android ecosystem fragmentation.",
keywords = "Android, Androids, automated testing, Bibliographies, Ecosystems, Humanoid robots, Java, literature review, survey, Systematics, Testing",
author = "Pingfan Kong and Li Li and Jun Gao and Kui Liu and Bissyande, {Tegawende F.} and Jacques Klein",
year = "2019",
month = "3",
doi = "10.1109/TR.2018.2865733",
language = "English",
volume = "68",
pages = "45--66",
journal = "IEEE Transactions on Reliability",
issn = "0018-9529",
publisher = "IEEE, Institute of Electrical and Electronics Engineers",
number = "1",

}

Automated testing of Android apps : a systematic literature review. / Kong, Pingfan; Li, Li; Gao, Jun; Liu, Kui; Bissyande, Tegawende F.; Klein, Jacques.

In: IEEE Transactions on Reliability, Vol. 68, No. 1, 03.2019, p. 45-66.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Automated testing of Android apps

T2 - a systematic literature review

AU - Kong, Pingfan

AU - Li, Li

AU - Gao, Jun

AU - Liu, Kui

AU - Bissyande, Tegawende F.

AU - Klein, Jacques

PY - 2019/3

Y1 - 2019/3

N2 - Automated testing of Android apps is essential for app users, app developers, and market maintainer communities alike. Given the widespread adoption of Android and the specificities of its development model, the literature has proposed various testing approaches for ensuring that not only functional requirements but also nonfunctional requirements are satisfied. In this paper, we aim at providing a clear overview of the state-of-the-art works around the topic of Android app testing, in an attempt to highlight the main trends, pinpoint the main methodologies applied, and enumerate the challenges faced by the Android testing approaches as well as the directions where the community effort is still needed. To this end, we conduct a systematic literature review during which we eventually identified 103 relevant research papers published in leading conferences and journals until 2016. Our thorough examination of the relevant literature has led to several findings and highlighted the challenges that Android testing researchers should strive to address in the future. After that, we further propose a few concrete research directions where testing approaches are needed to solve recurrent issues in app updates, continuous increases of app sizes, as well as the Android ecosystem fragmentation.

AB - Automated testing of Android apps is essential for app users, app developers, and market maintainer communities alike. Given the widespread adoption of Android and the specificities of its development model, the literature has proposed various testing approaches for ensuring that not only functional requirements but also nonfunctional requirements are satisfied. In this paper, we aim at providing a clear overview of the state-of-the-art works around the topic of Android app testing, in an attempt to highlight the main trends, pinpoint the main methodologies applied, and enumerate the challenges faced by the Android testing approaches as well as the directions where the community effort is still needed. To this end, we conduct a systematic literature review during which we eventually identified 103 relevant research papers published in leading conferences and journals until 2016. Our thorough examination of the relevant literature has led to several findings and highlighted the challenges that Android testing researchers should strive to address in the future. After that, we further propose a few concrete research directions where testing approaches are needed to solve recurrent issues in app updates, continuous increases of app sizes, as well as the Android ecosystem fragmentation.

KW - Android

KW - Androids

KW - automated testing

KW - Bibliographies

KW - Ecosystems

KW - Humanoid robots

KW - Java

KW - literature review

KW - survey

KW - Systematics

KW - Testing

UR - http://www.scopus.com/inward/record.url?scp=85052785916&partnerID=8YFLogxK

U2 - 10.1109/TR.2018.2865733

DO - 10.1109/TR.2018.2865733

M3 - Article

VL - 68

SP - 45

EP - 66

JO - IEEE Transactions on Reliability

JF - IEEE Transactions on Reliability

SN - 0018-9529

IS - 1

ER -