"Anarchy" reigns: A quantitative analysis of agent-based modelling publication practices in JASSS, 2001-2012

Research output: Contribution to journalArticleResearchpeer-review

10 Citations (Scopus)

Abstract

Agent Based Modelling (ABM), a promising scientific toolset, has received criticism from some, in part, due to a claimed lack of scientific rigour, especially in the communication of its methods and results. To test the veracity of these claims, we conduct a structured analysis of over 900 scientific objects (figures, tables, or equations) that arose from 128 ABM papers published in the Journal of Artificial Societies and Social Simulation (JASSS), during the period 2001 to 2012 inclusive. Regrettably, we find considerable evidence in support of the detractors of ABM as a scientific enterprise: elementary plotting attributes are left off more often than not; basic information such as the number of replicates or the basis behind a particular statistic are not included; and few, if any, established methodological communication standards are apparent. In short, anarchy reigns . Whilst the study was confined only to ABM papers of JASSS, we conclude that if the ABM community wishes its approach to be accepted further afield, authors, reviewers, and editors should take the results of our work as a wake-up call.
Original languageEnglish
Pages (from-to)1 - 20
Number of pages20
JournalJournal of Artificial Societies and Social Simulation
Volume18
Issue number4
DOIs
Publication statusPublished - 2015

Cite this

@article{b6c88916284b4dfcbd051006a30feef3,
title = "{"}Anarchy{"} reigns: A quantitative analysis of agent-based modelling publication practices in JASSS, 2001-2012",
abstract = "Agent Based Modelling (ABM), a promising scientific toolset, has received criticism from some, in part, due to a claimed lack of scientific rigour, especially in the communication of its methods and results. To test the veracity of these claims, we conduct a structured analysis of over 900 scientific objects (figures, tables, or equations) that arose from 128 ABM papers published in the Journal of Artificial Societies and Social Simulation (JASSS), during the period 2001 to 2012 inclusive. Regrettably, we find considerable evidence in support of the detractors of ABM as a scientific enterprise: elementary plotting attributes are left off more often than not; basic information such as the number of replicates or the basis behind a particular statistic are not included; and few, if any, established methodological communication standards are apparent. In short, anarchy reigns . Whilst the study was confined only to ABM papers of JASSS, we conclude that if the ABM community wishes its approach to be accepted further afield, authors, reviewers, and editors should take the results of our work as a wake-up call.",
author = "Simon Angus and {Hassani Mahmooei}, Behrooz",
year = "2015",
doi = "10.18564/jasss.2952",
language = "English",
volume = "18",
pages = "1 -- 20",
journal = "Journal of Artificial Societies and Social Simulation",
issn = "1460-7425",
publisher = "SimSoc Consortium",
number = "4",

}

TY - JOUR

T1 - "Anarchy" reigns: A quantitative analysis of agent-based modelling publication practices in JASSS, 2001-2012

AU - Angus, Simon

AU - Hassani Mahmooei, Behrooz

PY - 2015

Y1 - 2015

N2 - Agent Based Modelling (ABM), a promising scientific toolset, has received criticism from some, in part, due to a claimed lack of scientific rigour, especially in the communication of its methods and results. To test the veracity of these claims, we conduct a structured analysis of over 900 scientific objects (figures, tables, or equations) that arose from 128 ABM papers published in the Journal of Artificial Societies and Social Simulation (JASSS), during the period 2001 to 2012 inclusive. Regrettably, we find considerable evidence in support of the detractors of ABM as a scientific enterprise: elementary plotting attributes are left off more often than not; basic information such as the number of replicates or the basis behind a particular statistic are not included; and few, if any, established methodological communication standards are apparent. In short, anarchy reigns . Whilst the study was confined only to ABM papers of JASSS, we conclude that if the ABM community wishes its approach to be accepted further afield, authors, reviewers, and editors should take the results of our work as a wake-up call.

AB - Agent Based Modelling (ABM), a promising scientific toolset, has received criticism from some, in part, due to a claimed lack of scientific rigour, especially in the communication of its methods and results. To test the veracity of these claims, we conduct a structured analysis of over 900 scientific objects (figures, tables, or equations) that arose from 128 ABM papers published in the Journal of Artificial Societies and Social Simulation (JASSS), during the period 2001 to 2012 inclusive. Regrettably, we find considerable evidence in support of the detractors of ABM as a scientific enterprise: elementary plotting attributes are left off more often than not; basic information such as the number of replicates or the basis behind a particular statistic are not included; and few, if any, established methodological communication standards are apparent. In short, anarchy reigns . Whilst the study was confined only to ABM papers of JASSS, we conclude that if the ABM community wishes its approach to be accepted further afield, authors, reviewers, and editors should take the results of our work as a wake-up call.

U2 - 10.18564/jasss.2952

DO - 10.18564/jasss.2952

M3 - Article

VL - 18

SP - 1

EP - 20

JO - Journal of Artificial Societies and Social Simulation

JF - Journal of Artificial Societies and Social Simulation

SN - 1460-7425

IS - 4

ER -