The complexities of agent-based modeling output analysis

Ju-Sung Lee, Tatiana Filatova, Arika Ligmann-Zielinska, Behrooz Hassani Mahmooei, Forrest Stonedahl, Iris Lorscheid, Alexey Voinov, J Gary Polhill, Zhanli Sun, Dawn C Parker

Research output: Contribution to journalArticleResearchpeer-review

Abstract

The proliferation of agent-based models (ABMs) in recent decades has motivated model practitioners to improve the transparency, replicability, and trust in results derived from ABMs. The complexity of ABMs has risen in stride with advances in computing power and resources, resulting in larger models with complex interactions and learning and whose outputs are often high-dimensional and require sophisticated analytical approaches. Similarly, the increasing use of data and dynamics in ABMs has further enhanced the complexity of their outputs. In this article, we offer an overview of the state-of-the-art approaches in analyzing and reporting ABM outputs highlighting challenges and outstanding issues. In particular, we examine issues surrounding variance stability (in connection with determination of appropriate number of runs and hypothesis testing), sensitivity analysis, spatio-temporal analysis, visualization, and effective communication of all these to non-technical audiences, such as various stakeholders.
Original languageEnglish
Pages (from-to)1 - 27
Number of pages27
JournalJournal of Artificial Societies and Social Simulation
Volume18
Issue number4
DOIs
Publication statusPublished - 2015

Cite this

Lee, J-S., Filatova, T., Ligmann-Zielinska, A., Hassani Mahmooei, B., Stonedahl, F., Lorscheid, I., ... Parker, D. C. (2015). The complexities of agent-based modeling output analysis. Journal of Artificial Societies and Social Simulation, 18(4), 1 - 27. https://doi.org/10.18564/jasss.2897
Lee, Ju-Sung ; Filatova, Tatiana ; Ligmann-Zielinska, Arika ; Hassani Mahmooei, Behrooz ; Stonedahl, Forrest ; Lorscheid, Iris ; Voinov, Alexey ; Polhill, J Gary ; Sun, Zhanli ; Parker, Dawn C. / The complexities of agent-based modeling output analysis. In: Journal of Artificial Societies and Social Simulation. 2015 ; Vol. 18, No. 4. pp. 1 - 27.
@article{86a8292082124b61b46c807d1aa329ca,
title = "The complexities of agent-based modeling output analysis",
abstract = "The proliferation of agent-based models (ABMs) in recent decades has motivated model practitioners to improve the transparency, replicability, and trust in results derived from ABMs. The complexity of ABMs has risen in stride with advances in computing power and resources, resulting in larger models with complex interactions and learning and whose outputs are often high-dimensional and require sophisticated analytical approaches. Similarly, the increasing use of data and dynamics in ABMs has further enhanced the complexity of their outputs. In this article, we offer an overview of the state-of-the-art approaches in analyzing and reporting ABM outputs highlighting challenges and outstanding issues. In particular, we examine issues surrounding variance stability (in connection with determination of appropriate number of runs and hypothesis testing), sensitivity analysis, spatio-temporal analysis, visualization, and effective communication of all these to non-technical audiences, such as various stakeholders.",
author = "Ju-Sung Lee and Tatiana Filatova and Arika Ligmann-Zielinska and {Hassani Mahmooei}, Behrooz and Forrest Stonedahl and Iris Lorscheid and Alexey Voinov and Polhill, {J Gary} and Zhanli Sun and Parker, {Dawn C}",
year = "2015",
doi = "10.18564/jasss.2897",
language = "English",
volume = "18",
pages = "1 -- 27",
journal = "Journal of Artificial Societies and Social Simulation",
issn = "1460-7425",
publisher = "SimSoc Consortium",
number = "4",

}

Lee, J-S, Filatova, T, Ligmann-Zielinska, A, Hassani Mahmooei, B, Stonedahl, F, Lorscheid, I, Voinov, A, Polhill, JG, Sun, Z & Parker, DC 2015, 'The complexities of agent-based modeling output analysis' Journal of Artificial Societies and Social Simulation, vol. 18, no. 4, pp. 1 - 27. https://doi.org/10.18564/jasss.2897

The complexities of agent-based modeling output analysis. / Lee, Ju-Sung; Filatova, Tatiana; Ligmann-Zielinska, Arika; Hassani Mahmooei, Behrooz; Stonedahl, Forrest; Lorscheid, Iris; Voinov, Alexey; Polhill, J Gary; Sun, Zhanli; Parker, Dawn C.

In: Journal of Artificial Societies and Social Simulation, Vol. 18, No. 4, 2015, p. 1 - 27.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - The complexities of agent-based modeling output analysis

AU - Lee, Ju-Sung

AU - Filatova, Tatiana

AU - Ligmann-Zielinska, Arika

AU - Hassani Mahmooei, Behrooz

AU - Stonedahl, Forrest

AU - Lorscheid, Iris

AU - Voinov, Alexey

AU - Polhill, J Gary

AU - Sun, Zhanli

AU - Parker, Dawn C

PY - 2015

Y1 - 2015

N2 - The proliferation of agent-based models (ABMs) in recent decades has motivated model practitioners to improve the transparency, replicability, and trust in results derived from ABMs. The complexity of ABMs has risen in stride with advances in computing power and resources, resulting in larger models with complex interactions and learning and whose outputs are often high-dimensional and require sophisticated analytical approaches. Similarly, the increasing use of data and dynamics in ABMs has further enhanced the complexity of their outputs. In this article, we offer an overview of the state-of-the-art approaches in analyzing and reporting ABM outputs highlighting challenges and outstanding issues. In particular, we examine issues surrounding variance stability (in connection with determination of appropriate number of runs and hypothesis testing), sensitivity analysis, spatio-temporal analysis, visualization, and effective communication of all these to non-technical audiences, such as various stakeholders.

AB - The proliferation of agent-based models (ABMs) in recent decades has motivated model practitioners to improve the transparency, replicability, and trust in results derived from ABMs. The complexity of ABMs has risen in stride with advances in computing power and resources, resulting in larger models with complex interactions and learning and whose outputs are often high-dimensional and require sophisticated analytical approaches. Similarly, the increasing use of data and dynamics in ABMs has further enhanced the complexity of their outputs. In this article, we offer an overview of the state-of-the-art approaches in analyzing and reporting ABM outputs highlighting challenges and outstanding issues. In particular, we examine issues surrounding variance stability (in connection with determination of appropriate number of runs and hypothesis testing), sensitivity analysis, spatio-temporal analysis, visualization, and effective communication of all these to non-technical audiences, such as various stakeholders.

U2 - 10.18564/jasss.2897

DO - 10.18564/jasss.2897

M3 - Article

VL - 18

SP - 1

EP - 27

JO - Journal of Artificial Societies and Social Simulation

JF - Journal of Artificial Societies and Social Simulation

SN - 1460-7425

IS - 4

ER -