Author(s)

Zhen Li

Advisor(s)

Ningfang Mi

Contributor(s)

Waleed Meleis, Kaushik Chowdhury

Date of Award

8-2011

Date Accepted

8-2011

Degree Grantor

Northeastern University

Degree Level

M.S.

Degree Name

Master of Science

Department or Academic Unit

College of Engineering. Department of Electrical and Computer Engineering.

Keywords

burst, cluster system, heavy tail, load balancing, resource allocation

Disciplines

Electrical and Computer Engineering | Engineering

Abstract

A large-scale cluster computing system has been employed in the multiple areas by offering the pools of fundamental resources. How to effectively allocate the shared resources in a cluster system is a critical but challenging issue, which has been extensively studied in the past few years. Despite the fact that classic load balancing policies, such as Random, Join Shortest Queue and size-based polices, are widely implemented in actual systems due to their simplicity and efficiency, the performance benefts of these policies diminish when workloads are highly variable and heavily dependent. We propose a new load balancing policy ADuS, which attempts to partition jobs according to their sizes and to further rank the servers based on their loads. By dispatching jobs of similar size to the servers with the same ranking, ADuS can adaptively balance user traffic and system load in the system and thus achieve significant performance benefts. Extensive simulations show the effectiveness and the robustness of ADuS under many different environments.

Document Type

Master's Thesis

Rights Holder

Zhen Li


View Full Text

Click button above to open, or right-click to save.

Share

COinS