IMSuite: A benchmark suite for simulating distributed algorithms

• Genesis and characterization of a new kernel benchmark suite named IMSuite.
• A methodical approach to implement distributed algorithms in task parallel languages.
• Multiple variations of our kernels in two languages X10 and HJ.
• An involved set of input generators and output validators.
• A detailed evaluation of IMSuite.

Considering the diverse nature of real-world distributed applications that makes it hard to identify a representative subset of distributed benchmarks, we focus on their underlying distributed algorithms. We present and characterize a new kernel benchmark suite (named IMSuite) that simulates some of the classical distributed algorithms in task parallel languages. We present multiple variations of our kernels, broadly categorized under two heads: (a) varying synchronization primitives (with and without fine grain synchronization primitives); and (b) varying forms of parallelization (data parallel and recursive task parallel). Our characterization covers interesting aspects of distributed applications such as distribution of remote communication requests, number of synchronization, task creation, task termination and atomic operations. We study the behavior (execution time) of our kernels by varying the problem size, the number of compute threads, and the input configurations. We also present an involved set of input generators and output validators.