The xDotGrid native, cross-platform, high-performance xDFS file transfer framework

In this paper we introduce and describe the highly concurrent xDFS file transfer protocol and examine its cross-platform and cross-language implementation in native code for both Linux and Windows in 32 or 64-bit multi-core processor architectures. The implemented xDFS protocol based on xDotGrid.NET framework is fully compared with the Globus GridFTP protocol. We finally propose the xDFS protocol as a new paradigm of distributed systems for Internet services, and data-intensive Grid and Cloud applications. Also, we incrementally consider different developmental methods of the optimum file transfer systems, and their advantages and disadvantages. The vision of this paper tries as possible to minimize the overhead concerned with the file transfer protocol itself and to examine optimal software design patterns of that protocol. In all disk-to-disk tests for transferring a 2 GB file with or without parallelism, the xDFS throughput at minimum 30% and at most 53% was superior to the GridFTP.

Graphical abstractFigure optionsDownload full-size imageDownload as PowerPoint slideHighlights► Proposing the highly concurrent xDFS protocol for efficient file transfers. ► The native, cross-platform and cross-language implementation of the xDFS protocol. ► Referring several technical metrics to program client–server applications. ► Introducing the position of the xDFS framework among parallel storage systems. ► Proposing multi-threaded event-driven pipelined xDFS server architecture.