کد مقاله کد نشریه سال انتشار مقاله انگلیسی نسخه تمام متن
6905930 1447047 2018 12 صفحه PDF دانلود رایگان
عنوان انگلیسی مقاله ISI
Pipeline Collector: Gathering performance data for distributed astronomical pipelines
موضوعات مرتبط
مهندسی و علوم پایه مهندسی کامپیوتر نرم افزارهای علوم کامپیوتر
پیش نمایش صفحه اول مقاله
Pipeline Collector: Gathering performance data for distributed astronomical pipelines
چکیده انگلیسی
Modern astronomical data processing requires complex software pipelines to process ever growing datasets. For radio astronomy, these pipelines have become so large that they need to be distributed across a computational cluster. This makes it difficult to monitor the performance of each pipeline step. To gain insight into the performance of each step, a performance monitoring utility needs to be integrated with the pipeline execution. In this work we have developed such a utility and integrated it with the calibration pipeline of the Low Frequency Array, LOFAR, a leading radio telescope. We tested the tool by running the pipeline on several different compute platforms and collected the performance data. Based on this data, we make well informed recommendations on future hardware and software upgrades. The aim of these upgrades is to accelerate the slowest processing steps for this LOFAR pipeline. The pipeline_collector suite is open source and will be incorporated in future LOFAR pipelines to create a performance database for all LOFAR processing.
ناشر
Database: Elsevier - ScienceDirect (ساینس دایرکت)
Journal: Astronomy and Computing - Volume 24, July 2018, Pages 117-128
نویسندگان
, , , , ,