Auto-tuning Non-blocking Collective Communication Operations

Youcef Barigou, Vishwanath Venkatesan, Edgar Gabriel

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations


Collective operations are widely used in large scale scientific applications, and critical to the scalability of these applications for large process counts. It has also been demonstrated that collective operations have to be carefully tuned for a given platform and application scenario to maximize their performance. Non-blocking collective operations extend the concept of collective operations by offering the additional benefit of being able to overlap communication and computation. This paper presents the automatic run-time tuning of non-blocking collective communication operations, which allows the communication library to choose the best performing implementation for a non-blocking collective operation on a case by case basis. The paper demonstrates that libraries using a single algorithm or implementation for a non-blocking collective operation will inevitably lead to suboptimal performance in many scenarios, and thus validate the necessity for run-time tuning of these operations. The benefits of the approach are further demonstrated for an application kernel using a multi-dimensional Fast Fourier Transform. The results obtained for the application scenario indicate a performance improvement of up to 40% compared to the current state of the art.
Original languageEnglish (US)
Title of host publication2015 IEEE International Parallel and Distributed Processing Symposium Workshop
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Number of pages10
ISBN (Print)9781467376846
StatePublished - May 2015
Externally publishedYes


Dive into the research topics of 'Auto-tuning Non-blocking Collective Communication Operations'. Together they form a unique fingerprint.

Cite this