Decoupling a resource constraint through fictitious play in multi-agent sequential decision making

Frits De Nijs, Matthijs T.J. Spaan, Mathijs M. De Weerdt

Research output: Chapter in Book/Report/Conference proceedingConference PaperOtherpeer-review


When multiple independent agents use a limited shared resource, they need to coordinate and thereby their planning problems become coupled. We present a resource assignment strategy that decouples agents using marginal utility cost, allowing them to plan individually. We show that agents converge to an expected cost curve by keeping a history of plans, inspired by fictitious play. This performs slightly better than a state-of-the-art best-response approach and is significantly more scalable than a preallocation Mixed-Integer Linear Programming formulation, providing a good trade-off between performance and quality.

Original languageEnglish
Title of host publicationECAI 2016
Subtitle of host publication22nd European Conference on Artificial Intelligence - 29 August-2 September 2016, The Hague, The Netherlands
EditorsGal A. Kaminka, Maria Fox, Paolo Bouquet, Eyke Hullermeier, Virgina Dignum, Frank Dignum, Frank van Harmelen
Place of PublicationAmsterdam Netherlands
PublisherIOS Press
Number of pages2
ISBN (Electronic)9781614996729
ISBN (Print)9781614996712
Publication statusPublished - 1 Jan 2016
Externally publishedYes
EventEuropean Conference on Artificial Intelligence 2016 - The Hague, Netherlands
Duration: 29 Aug 20162 Sep 2016
Conference number: 22nd

Publication series

NameFrontiers in Artificial Intelligence and Applications
PublisherIOS Press
ISSN (Print)0922-6389


ConferenceEuropean Conference on Artificial Intelligence 2016
Abbreviated titleECAI 2016
CityThe Hague
Internet address

Cite this