An Aggregate MapReduce Data Block Placement Strategy for Wireless IoT Edge Nodes in Smart Grid

Nawab Muhammad Faseeh Qureshi, Isma Farah Siddiqui, Mukhtiar Ali Unar, Muhammad Aslam Uqaili, Choon Sung Nam, Dong Ryeol Shin, Jaehyoun Kim, Ali Kashif Bashir, Asad Abbas

Research output: Contribution to journalArticleResearchpeer-review

37 Citations (Scopus)

Abstract

Big data analytics has simplified processing complexity of large dataset in a distributed environment. Many state-of-the-art platforms i.e. smart grid has adopted the processing structure of big data and manages a large volume of data through MapReduce paradigm at distribution ends. Thus, whenever a wireless IoT edge node bundles a sensor dataset into storage media, MapReduce agent performs analytics and generates output into the grid repository. This practice has efficiently reduced the consumption of resources in such a giant network and strengthens other components of the smart grid to perform data analytics through aggregate programming. However, it consumes an operational latency of accessing large dataset from a central repository. As we know that, smart grid processes I/O operations of multi-homing networks, therefore, it accesses large datasets for processing MapReduce jobs at wireless IoT edge nodes. As a result, aggregate MapReduce at wireless IoT edge node produces a network congestion and operational latency problem. To overcome this issue, we propose Wireless IoT Edge-enabled Block Replica Strategy (WIEBRS), that stores in-place, partition-based and multi-homing block replica to respective edge nodes. This reduces the delay latency of accessing datasets for aggregate MapReduce and increases the performance of the job in the smart grid. The simulation results show that WIEBRS effective decreases operational latency with an increment of aggregate MapReduce job performance in the smart grid.

Original languageEnglish
Pages (from-to)2225-2236
Number of pages12
JournalWireless Personal Communications
Volume106
Issue number4
DOIs
Publication statusPublished - 30 Jun 2019
Externally publishedYes

Keywords

  • Aggregate MapReduce block placement
  • Hadoop
  • HDFS
  • Smart grid
  • Wireless IoT edge node

Cite this