Control of connected Markov chains. Application to congestion avoidance in the internet

Alexander Miller, Boris Miller

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

9 Citations (Scopus)

Abstract

The article considers the optimal control for the system of finite number of controlled connected Markov chains (CMC). Such models come from queuing systems with many service lines and/or from the control of resources of multiple connected dams. The state of such CMC is represented as a tensor of the depth d; where d is the number of controlled chains. This tensor form is much more convenient for derivation of the dynamic programming equation. We give a tensor form for the control problems arising in the router control which is aimed to the congestion avoidance with the aid of two telecommunication lines having different properties and cost of services.
Original languageEnglish
Title of host publicationProceedings of the 50th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC)
EditorsMarios Polycarpou
Place of PublicationUSA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages7242 - 7248
Number of pages7
DOIs
Publication statusPublished - 2011
EventIEEE Conference of Decision and Control (CDC)/European Control Conference (ECC) 2011 - Hilton Orlando Bonnet Creek, Orlando, United States of America
Duration: 12 Dec 201115 Dec 2011
Conference number: 50th
http://www.ieeecss.org/CAB/conferences/cdcecc2011/cfp.php
https://www.ieee.org/conferences_events/conferences/conferencedetails/index.html?Conf_ID=15803

Conference

ConferenceIEEE Conference of Decision and Control (CDC)/European Control Conference (ECC) 2011
Abbreviated titleCDC-ECC 2011
CountryUnited States of America
CityOrlando
Period12/12/1115/12/11
Other2011 50th IEEE Conference on Decision and Control and European Control Conference, CDC-ECC 2011
Internet address

Cite this

Miller, A., & Miller, B. (2011). Control of connected Markov chains. Application to congestion avoidance in the internet. In M. Polycarpou (Ed.), Proceedings of the 50th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC) (pp. 7242 - 7248). USA: IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/CDC.2011.6161029
Miller, Alexander ; Miller, Boris. / Control of connected Markov chains. Application to congestion avoidance in the internet. Proceedings of the 50th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC). editor / Marios Polycarpou. USA : IEEE, Institute of Electrical and Electronics Engineers, 2011. pp. 7242 - 7248
@inproceedings{cde8e92fe7054d03a3fb19bde803a6b7,
title = "Control of connected Markov chains. Application to congestion avoidance in the internet",
abstract = "The article considers the optimal control for the system of finite number of controlled connected Markov chains (CMC). Such models come from queuing systems with many service lines and/or from the control of resources of multiple connected dams. The state of such CMC is represented as a tensor of the depth d; where d is the number of controlled chains. This tensor form is much more convenient for derivation of the dynamic programming equation. We give a tensor form for the control problems arising in the router control which is aimed to the congestion avoidance with the aid of two telecommunication lines having different properties and cost of services.",
author = "Alexander Miller and Boris Miller",
year = "2011",
doi = "10.1109/CDC.2011.6161029",
language = "English",
pages = "7242 -- 7248",
editor = "Marios Polycarpou",
booktitle = "Proceedings of the 50th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC)",
publisher = "IEEE, Institute of Electrical and Electronics Engineers",
address = "United States of America",

}

Miller, A & Miller, B 2011, Control of connected Markov chains. Application to congestion avoidance in the internet. in M Polycarpou (ed.), Proceedings of the 50th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC). IEEE, Institute of Electrical and Electronics Engineers, USA, pp. 7242 - 7248, IEEE Conference of Decision and Control (CDC)/European Control Conference (ECC) 2011, Orlando, United States of America, 12/12/11. https://doi.org/10.1109/CDC.2011.6161029

Control of connected Markov chains. Application to congestion avoidance in the internet. / Miller, Alexander; Miller, Boris.

Proceedings of the 50th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC). ed. / Marios Polycarpou. USA : IEEE, Institute of Electrical and Electronics Engineers, 2011. p. 7242 - 7248.

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

TY - GEN

T1 - Control of connected Markov chains. Application to congestion avoidance in the internet

AU - Miller, Alexander

AU - Miller, Boris

PY - 2011

Y1 - 2011

N2 - The article considers the optimal control for the system of finite number of controlled connected Markov chains (CMC). Such models come from queuing systems with many service lines and/or from the control of resources of multiple connected dams. The state of such CMC is represented as a tensor of the depth d; where d is the number of controlled chains. This tensor form is much more convenient for derivation of the dynamic programming equation. We give a tensor form for the control problems arising in the router control which is aimed to the congestion avoidance with the aid of two telecommunication lines having different properties and cost of services.

AB - The article considers the optimal control for the system of finite number of controlled connected Markov chains (CMC). Such models come from queuing systems with many service lines and/or from the control of resources of multiple connected dams. The state of such CMC is represented as a tensor of the depth d; where d is the number of controlled chains. This tensor form is much more convenient for derivation of the dynamic programming equation. We give a tensor form for the control problems arising in the router control which is aimed to the congestion avoidance with the aid of two telecommunication lines having different properties and cost of services.

UR - http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6161029

U2 - 10.1109/CDC.2011.6161029

DO - 10.1109/CDC.2011.6161029

M3 - Conference Paper

SP - 7242

EP - 7248

BT - Proceedings of the 50th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC)

A2 - Polycarpou, Marios

PB - IEEE, Institute of Electrical and Electronics Engineers

CY - USA

ER -

Miller A, Miller B. Control of connected Markov chains. Application to congestion avoidance in the internet. In Polycarpou M, editor, Proceedings of the 50th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC). USA: IEEE, Institute of Electrical and Electronics Engineers. 2011. p. 7242 - 7248 https://doi.org/10.1109/CDC.2011.6161029