Flexible architecture for cluster evolution in cloud computing

•FACE supports system primitives that allow application developers to develop various applications in clouds.•FACE allows application developers to customize data partitioning, localization, and processing procedures.•FACE designs its system primitives in a language-independent and platform-independent way.•FACE makes extensible the Master of a MapReduce system by application developers.

MapReduce is considered the key behind the success of cloud computing because it not only makes a cluster highly scalable but also allows applications to use resources in a cluster. However, MapReduce achieves this simplicity at the expense of flexibility for data partitioning, localization, and processing procedures by handling all issues on behalf of application developers. Unfortunately, MapReduce currently has no solution capable of giving application developers flexibility in customizing data partitioning, localization, and processing procedures. To address the aforementioned flexibility constraints of MapReduce, we propose an architecture called Flexible Architecture for Cluster Evolution (FACE) which is both language-independent and platform-independent. FACE allows a MapReduce cluster to be designed to match various application requirements by customizing data partitioning, localization, and processing procedures. We compare the performance of FACE with that of a general MapReduce system and then demonstrate performance improvements with our implemented procedures.

Graphical abstractFigure optionsDownload full-size imageDownload as PowerPoint slide