Control of connected Markov chains. Application to congestion avoidance in the internet

Alexander Miller, Boris Miller

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

11 Citations (Scopus)

Abstract

The article considers the optimal control for the system of finite number of controlled connected Markov chains (CMC). Such models come from queuing systems with many service lines and/or from the control of resources of multiple connected dams. The state of such CMC is represented as a tensor of the depth d; where d is the number of controlled chains. This tensor form is much more convenient for derivation of the dynamic programming equation. We give a tensor form for the control problems arising in the router control which is aimed to the congestion avoidance with the aid of two telecommunication lines having different properties and cost of services.
Original languageEnglish
Title of host publicationProceedings of the 50th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC)
EditorsMarios Polycarpou
Place of PublicationUSA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages7242 - 7248
Number of pages7
DOIs
Publication statusPublished - 2011
EventIEEE Conference of Decision and Control (CDC)/European Control Conference (ECC) 2011 - Hilton Orlando Bonnet Creek, Orlando, United States of America
Duration: 12 Dec 201115 Dec 2011
Conference number: 50th
http://www.ieeecss.org/CAB/conferences/cdcecc2011/cfp.php
https://www.ieee.org/conferences_events/conferences/conferencedetails/index.html?Conf_ID=15803

Conference

ConferenceIEEE Conference of Decision and Control (CDC)/European Control Conference (ECC) 2011
Abbreviated titleCDC-ECC 2011
CountryUnited States of America
CityOrlando
Period12/12/1115/12/11
Other2011 50th IEEE Conference on Decision and Control and European Control Conference, CDC-ECC 2011
Internet address

Cite this