کد مقاله | کد نشریه | سال انتشار | مقاله انگلیسی | نسخه تمام متن |
---|---|---|---|---|
461288 | 696582 | 2016 | 11 صفحه PDF | دانلود رایگان |

• Proposes a dynamically coordinated I/O architecture based on input parameters.
• Creates, on the fly, dedicated or semi-dedicated clusters of HDDs per job.
• Provides coordinated parallel data transfers on the overall data flow.
• Minimizes disk and network contention.
• Improves performance by 33% with the 1/3 of the available hard disks.
High performance computing (HPC) has crossed the Petaflop mark and is reaching the Exaflop range quickly. The exascale system is projected to have millions of nodes, with thousands of cores for each node. At such an extreme scale, the substantial amount of concurrency can cause a critical contention issue for I/O system. This study proposes a dynamically coordinated I/O architecture for addressing some of the limitations that current parallel file systems and storage architectures are facing with very large-scale systems. The fundamental idea is to coordinate I/O accesses according to the topology/profile of the infrastructure, the load metrics, and the I/O demands of each application. The measurements have shown that by using IKAROS approach we can fully utilize the provided I/O and network resources, minimize disk and network contention, and achieve better performance.
Journal: Journal of Systems and Software - Volume 118, August 2016, Pages 277–287