MapReduce scheduling algorithms: a review

Ibrahim Abaker Targio Hashem, Nor Badrul Anuar, Mohsen Marjani, Ejaz Ahmed, Haruna Chiroma, Ahmad Firdaus, Muhamad Taufik Abdullah, Faiz Alotaibi, Waleed Kamaleldin Mahmoud Ali, Ibrar Yaqoob, Abdullah Gani

Research output: Contribution to journalArticlepeer-review

29 Scopus citations

Abstract

Recent trends in big data have shown that the amount of data continues to increase at an exponential rate. This trend has inspired many researchers over the past few years to explore new research direction of studies related to multiple areas of big data. The widespread popularity of big data processing platforms using MapReduce framework is the growing demand to further optimize their performance for various purposes. In particular, enhancing resources and jobs scheduling are becoming critical since they fundamentally determine whether the applications can achieve the performance goals in different use cases. Scheduling plays an important role in big data, mainly in reducing the execution time and cost of processing. This paper aims to survey the research undertaken in the field of scheduling in big data platforms. Moreover, this paper analyzed scheduling in MapReduce on two aspects: taxonomy and performance evaluation. The research progress in MapReduce scheduling algorithms is also discussed. The limitations of existing MapReduce scheduling algorithms and exploit future research opportunities are pointed out in the paper for easy identification by researchers. Our study can serve as the benchmark to expert researchers for proposing a novel MapReduce scheduling algorithm. However, for novice researchers, the study can be used as a starting point.

Original languageBritish English
Pages (from-to)4915-4945
Number of pages31
JournalJournal of Supercomputing
Volume76
Issue number7
DOIs
StatePublished - 1 Jul 2020

Keywords

  • Big data
  • Cloud computing
  • Hadoop
  • MapReduce
  • Scheduling algorithms

Fingerprint

Dive into the research topics of 'MapReduce scheduling algorithms: a review'. Together they form a unique fingerprint.

Cite this