Optimal stochastic power control for energy harvesting systems with statistical delay constraint

Imtiaz Ahmed, Khoa Tran Phan, Tho Le-Ngoc

Research output: Chapter in Book/Report/Conference proceedingConference PaperOtherpeer-review

1 Citation (Scopus)


This paper studies optimal stochastic power control problem for a time-varying communication link, where the transmitter randomly harvests renewable energies from the environment. The harvested energies are stored in an energy buffer (or battery). Packets arrive at the transmitter data buffer with a constant rate μ. The objective is to maximize μ under the statistical delay and energy harvesting (EH) constraints. In order to study the optimal power control policy, we reformulate the problem as an infinite-horizon Markov decision process (MDP) using asymptotic delay analysis. The optimal policy and its structural properties are studied by employing the post-decision framework approach. We then propose an online power control algorithm, which converges to the optimal solution without requiring the statistical knowledge of the channel fading and EH processes. Numerical results demonstrate the effectiveness of the online algorithm for different delay constraints and EH settings.

Original languageEnglish
Title of host publication2015 IEEE Global Communications Conference, GLOBECOM 2015
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages6
ISBN (Electronic)9781479959525
Publication statusPublished - 2015
Externally publishedYes
EventIEEE Global Telecommunications Conference 2015 - San Diego, United States of America
Duration: 6 Dec 201510 Dec 2015
https://ieeexplore.ieee.org/xpl/conhome/7414714/proceeding (Proceedings)


ConferenceIEEE Global Telecommunications Conference 2015
Abbreviated titleIEEE GLOBECOM 2015
CountryUnited States of America
CitySan Diego
OtherIEEE GLOBECOM is one of two flagship conferences of the IEEE Communications Society (ComSoc), together with IEEE ICC. Each year the conference attracts about 3000 submitted scientific papers and dozens of proposals for industry events. A technical program committee of more than 1,500 experts provides more than 10,000 reviews, and from this a small fraction of the submitted papers are accepted for publication and presentation at the conference. The conference meets once a year in North America and attracts roughly 2000 leading scientists, researchers and industry practitioners from all around the world. IEEE GLOBECOM is therefore one of the most significant scientific events of the networking and communications community, a must-attend event for scientists, researchers and networking practitioners from industry and academia.
Internet address


  • Energy harvesting
  • Optimal stochastic control
  • Statistical delay constraints

Cite this