Optimal control of a large dam using time-inhomogeneous Markov chains with an application to flood control

Daniel James McInnes, Boris Miller

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

9 Citations (Scopus)


We consider a decision making framework for a dam modelled by a controllable time-inhomogeneous Markov chain with a compound Poisson process as an input, which approximates the inflow pattern of real dams with seasonal rainfall. The controls are responsible for output flow explicitly and implicitly via a price on water consumption. We consider the problem with system balance and demand shortfall performance criteria under constraints. The state space of the dam is discretized while the time domain remains continuous. We also add a controllable water release to reduce the probability of the dam overflowing and give the procedure for determining if an optimal solution exists by showing the consistency of constraints.
Original languageEnglish
Title of host publication20th IFAC World Congress
EditorsDenis Dochain, Didier Henrion, Dimitri Peaucelle
Number of pages6
Publication statusPublished - Jul 2017

Publication series

NameIFAC PapersOnLine
PublisherInternational Federation of Automatic Control
ISSN (Print)2405-8963

Cite this