Dual time-scale distributed capacity allocation and load redirect algorithms for cloud systems

Resource management remains one of the main issues of cloud computing providers because system resources have to be continuously allocated to handle workload fluctuations while guaranteeing Service Level Agreements (SLA) to the end users. In this paper, we propose novel capacity allocation algorithms able to coordinate multiple distributed resource controllers operating in geographically distributed cloud sites. Capacity allocation solutions are integrated with a load redirection mechanism which, when necessary, distributes incoming requests among different sites. The overall goal is to minimize the costs of allocated resources in terms of virtual machines, while guaranteeing SLA constraints expressed as a threshold on the average response time. We propose a distributed solution which integrates workload prediction and distributed non-linear optimization techniques. Experiments show how the proposed solutions improve other heuristics proposed in literature without penalizing SLAs, and our results are close to the global optimum which can be obtained by an oracle with a perfect knowledge about the future offered load.

► Distributed capacity allocation and load redirect techniques for cloud systems.
► Non-linear optimization integrated with workload prediction and estimation models.
► Analysis based on simulations and experiments on a real prototype on Amazon EC2.
► We improve other heuristics reducing cloud costs, without penalizing QoS.
► Solutions close to the optimum achieved by an oracle with knowledge of the future.