Joint scheduling - Traffic admission control: Structural results and online learning algorithm

Khoa T. Phan, Tho Le-Ngoc, Mihaela Van Der Schaar, Fangwen Fu

Research output: Chapter in Book/Report/Conference proceedingConference PaperOtherpeer-review


This work studies the joint scheduling - admission control (SAC) problem over a fading channel. In particular, the optimal trade-off between maximizing the throughput and minimizing the queue size (or average congestion) is investigated. The SAC problem is formulated as a constrained Markov decision process (MDP) to maximize a utility defined as a function of the throughput and the queue size. The structural properties of the optimal policies are subsequently derived. When the statistical knowledge of the traffic arrival and channel processes is not available, we propose an online learning algorithm for the optimal policies. The analysis and algorithm development are relied on the reformulation of the Bellman's optimality dynamic programming equation using suitably defined value functions which can be learned using online time-averaging.

Original languageEnglish
Title of host publication2013 IEEE International Conference on Communications, ICC 2013
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages5
ISBN (Print)9781467331227
Publication statusPublished - 2013
Externally publishedYes
EventIEEE International Conference on Communications 2013: Bridging the Broadband Divide - Budapest, Hungary
Duration: 9 Jun 201313 Jun 2013 (IEEE Conference Proceedings)


ConferenceIEEE International Conference on Communications 2013
Abbreviated titleICC 2013
OtherThe International Conference on Communications (ICC) is one of the two flagship conferences of the IEEE Communications Society, together with IEEE Globecom. Each year the ICC conference attracts about 2-3.000 submitted scientific papers, a technical program committee involving about 1.500 experts provides more than 10.000 reviews, the conference being finally attended by 1.500 - 2.000 professionals from all around the world. IEEE ICC is therefore one of the most significant scientific events of the networking and communications community, a must-attend forum for both industrials and academics working in this area.
Internet address


  • learning
  • Markov decision process (MDP)
  • Scheduling
  • structural results
  • traffic admission control

Cite this