Adaptive instruction dispatching techniques for Simultaneous Multi-Threading (SMT) processors

Simultaneous Multi-Threading (SMT) provides a technique to improve resource utilization ability by sharing key data-path components among multiple independent threads. When critical resources are shared by multiple threads, effective use of these resources proves to be the most important factor in fully exploiting the system potential. Transient behaviors of various threads in terms of their execution parallelism can easily affect utilization efficiency of these shared resources. To commit more resources to threads that are more active allows for better resource utilization and thus higher throughput. In this paper, we propose a real-time dynamic scheduler for the SMT which dispatches instructions from threads based on thread-activeness information gathered in real time and dynamically adjusts dispatching priorities among threads accordingly. An extensive simulation shows a significant gain in system throughput by this technique. The performance of the proposed dispatching technique is evaluated on different workload mixtures created based on instruction-level parallelism available in each thread. An average of 6.5% and maximum of 15% performance improvement is observed with the proposed dispatching technique.

Figure optionsDownload as PowerPoint slideHighlights
► Proposes a real-time dynamic scheduler for SMT that dispatches instructions threads based on thread-activeness.
► An average of 6.5% and maximum of 15% performance improvement is observed.
► The algorithm achieves the performance gain without having to modify the structures of the ROBs and IQ.