Bayesian network meta-models from combat simulation for defence decision analysis

Abida Shahzad, Steven Mascaro, Thang Cao, Kevin B. Korb

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

Abstract

Defence Science and Technology Group (DST) is investigating the characteristics of Land Combat Vehicles (LCVs) with a view to improving purchasing decisions between different LCV options. Using a combination of closed-loop combat simulation (i.e., one run without any human interventions) and subject matter experts (SMEs), these studies seek to understand the close combat capability factors for a future LCV. These factors are being investigated for different kinds of physical environment and different levels of enemy lethality, with each LCV's lethality, survivability, signature (the ease with which the enemy identifies friendly forces) and knowledge acquisition (friendly forces identifying enemies) being measured, yielding a multi-dimensional view of the different LCVs and their performance. Our study describes a new approach, developing a Bayesian network (BN) meta-model (i.e., a model based upon the combat simulation model; see Fig 1) that combines those multiple dimensions in a single multicriterial decision model. Figure 1. A Bayesian network meta-model (from the PC algorithm). Both deterministic and stochastic methods have been developed for multicriteria decision analysis (MCDA). Limitations to prior approaches include treating utilities as independent of each other and also very limited ability to deal with uncertainty about preferences. Bayesian networks offer advantages in these regards, so here we develop an alternative approach using a BN meta-model for decision making and evaluating the operational impact of different LCV choices. BNs support both the prediction of operational results and their causal explanation. These BNs were developed both from expert elicitation and causal discovery (data mining) from combat simulation data, and enable causal visualization, sensitivity analysis and optimization. We evaluate the performance of some of these BNs against alternatives, using common accuracy-based evaluation metrics. Please note that the example and data presented in this paper are not representative of the real LCV options and testing scenario, they are used for methodology illustration only.

Original languageEnglish
Title of host publicationThe 23rd International Congress on Modelling and Simulation (MODSIM2019)
EditorsS. Elsawah
Place of PublicationACT Australia
PublisherModelling and Simulation Society of Australia and New Zealand (MSSANZ)
Pages351-357
Number of pages7
ISBN (Electronic)9780975840092
DOIs
Publication statusPublished - 2019
EventInternational Congress on Modelling and Simulation 2019 - Canberra, Australia
Duration: 1 Dec 20196 Dec 2019
Conference number: 23rd
https://mssanz.org.au/modsim2019/

Conference

ConferenceInternational Congress on Modelling and Simulation 2019
Abbreviated titleMODSIM 2019
CountryAustralia
CityCanberra
Period1/12/196/12/19
Internet address

Keywords

  • Bayesian network modelling
  • Combat simulation and model evaluation
  • Multicriteria decision analysis

Cite this

Shahzad, A., Mascaro, S., Cao, T., & Korb, K. B. (2019). Bayesian network meta-models from combat simulation for defence decision analysis. In S. Elsawah (Ed.), The 23rd International Congress on Modelling and Simulation (MODSIM2019) (pp. 351-357). Modelling and Simulation Society of Australia and New Zealand (MSSANZ). https://doi.org/10.36334/modsim.2019.B8.shahzad