A closed queuing network model with multiple servers for multi-threaded architecture

In this paper, a closed queuing network model with multiple servers has been proposed to model dataflow in a multi-threaded architecture. Multi-threading is useful in reducing the latency by switching among a set of threads in order to improve the processor utilization. Two sets of processors, synchronization and execution processors exist. Synchronization processors handle load/store operations and execution processors handle arithmetic/logic and control operations. A closed queuing network model is suitable for large number of job arrivals. The normalization constant is derived using a recursive algorithm for the given model. State diagrams are drawn from the closed queuing network model with multiple servers, and the steady-state balance equations are derived from it. Performance measures such as response times and system throughput are derived and plotted against the total number of processors in the closed queuing network model. Other important performance measures like processor utilizations, queue lengths, waiting times and relative utilizations are also derived.