Affiliation of Author(s):计算机科学与技术学院/人工智能学院/软件学院

Journal:SIGNAL IMAGE AND VIDEO PROCESSING

Key Words:Energy saving Big data Homogeneous cluster Data placement strategy Workload balance

Abstract:The size of data centers is becoming larger to deal with the exponential data growth, and the energy consumption challenges the services providers and the environment. Various data placement strategies were developed to reduce the energy consumption of processing big data on the level of storage system, but they were typically developed for specific applications and storage medium. This paper proposes an energy-aware algorithm EABD of processing big data in homogeneous cluster with general data storage. We show that a variation of this optimization can be reduced to set cover problem, and a heuristic algorithm is proposed to reduce the energy consumption by selecting proper nodes and assigning balanced workload to each selected node. This algorithm will not be influenced by the data placement strategies and storage medium. Simulation results show that our algorithm significantly reduces energy consumption in different situations.

ISSN No.:1863-1703

Translation or Not:no

Date of Publication:2017-02-01

Co-author:Ding, Youwei,F70206059,Liu Liang,Wang, Taochun

Correspondence Author:qxz