Decoupling a resource constraint through fictitious play in multi-agent sequential decision making

Frits De Nijs, Matthijs T.J. Spaan, Mathijs M. De Weerdt

Research output: Chapter in Book/Report/Conference proceedingConference PaperOtherpeer-review

Abstract

When multiple independent agents use a limited shared resource, they need to coordinate and thereby their planning problems become coupled. We present a resource assignment strategy that decouples agents using marginal utility cost, allowing them to plan individually. We show that agents converge to an expected cost curve by keeping a history of plans, inspired by fictitious play. This performs slightly better than a state-of-the-art best-response approach and is significantly more scalable than a preallocation Mixed-Integer Linear Programming formulation, providing a good trade-off between performance and quality.

Original languageEnglish
Title of host publicationECAI 2016
Subtitle of host publication22nd European Conference on Artificial Intelligence - 29 August-2 September 2016, The Hague, The Netherlands
EditorsGal A. Kaminka, Maria Fox, Paolo Bouquet, Eyke Hullermeier, Virgina Dignum, Frank Dignum, Frank van Harmelen
Place of PublicationAmsterdam Netherlands
PublisherIOS Press
Pages1724-1725
Number of pages2
ISBN (Electronic)9781614996729
ISBN (Print)9781614996712
DOIs
Publication statusPublished - 1 Jan 2016
Externally publishedYes
EventEuropean Conference on Artificial Intelligence 2016 - The Hague, Netherlands
Duration: 29 Aug 20162 Sep 2016
Conference number: 22nd
http://www.ecai2016.org/

Publication series

NameFrontiers in Artificial Intelligence and Applications
PublisherIOS Press
Volume285
ISSN (Print)0922-6389

Conference

ConferenceEuropean Conference on Artificial Intelligence 2016
Abbreviated titleECAI 2016
CountryNetherlands
CityThe Hague
Period29/08/162/09/16
Internet address

Cite this