Preallocation and planning under stochastic resource constraints

Frits de Nijs, Matthijs T.J. Spaan, Mathijs M. deWeerdt

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

Abstract

Resource constraints frequently complicate multi-agent planning problems. Existing algorithms for resource-constrained, multi-agent planning problems rely on the assumption that the constraints are deterministic. However, frequently resource constraints are themselves subject to uncertainty from external influences. Uncertainty about constraints is especially challenging when agents must execute in an environment where communication is unreliable, making on-line coordination difficult. In those cases, it is a significant challenge to find coordinated allocations at plan time depending on availability at run time. To address these limitations, we propose to extend algorithms for constrained multi-agent planning problems to handle stochastic resource constraints. We show how to factorize resource limit uncertainty and use this to develop novel algorithms to plan policies for stochastic constraints.We evaluate the algorithms on a search-and-rescue problem and on a power-constrained planning domain where the resource constraints are decided by nature. We show that plans taking into account all potential realizations of the constraint obtain significantly better utility than planning for the expectation, while causing fewer constraint violations.
Original languageEnglish
Title of host publicationThe Thirty-Second AAAI Conference on Artificial Intelligence
Subtitle of host publicationNew Orleans, Louisiana USA — February 2–7, 2018
EditorsSheila McIlraith, Kilian Weinberger
Place of PublicationPalo Alto California USA
PublisherAssociation for the Advancement of Artificial Intelligence (AAAI)
Pages4662-4669
Number of pages8
ISBN (Electronic)9781577358008
Publication statusPublished - 2018
Externally publishedYes

Cite this

de Nijs, F., Spaan, M. T. J., & M. deWeerdt, M. (2018). Preallocation and planning under stochastic resource constraints. In S. McIlraith, & K. Weinberger (Eds.), The Thirty-Second AAAI Conference on Artificial Intelligence: New Orleans, Louisiana USA — February 2–7, 2018 (pp. 4662-4669). Association for the Advancement of Artificial Intelligence (AAAI). https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/download/17397/15992