License: Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported license (CC BY-NC-ND 3.0)
When quoting this document, please refer to the following
DOI: 10.4230/OASIcs.ICCSW.2012.135
URN: urn:nbn:de:0030-drops-37771
URL: http://dagstuhl.sunsite.rwth-aachen.de/volltexte/2012/3777/
Go to the corresponding OASIcs Volume Portal

Tan, Wilson M. ; Jarvis, Stephen A.

Blurring the Computation-Communication Divide: Extraneous Memory Accesses and their Effects on MPI Intranode Communications

pdf-format:
22.pdf (0.9 MB)

Abstract

Modern MPI simulator frameworks assume the existence of a Computation-Communication Divide: thus, they model and simulate the computation and communication sections of an MPI Program separately. The assumption is actually sound for MPI processes that are situated in different nodes and communicate through a network medium such as Ethernet or Infiniband. For processes that are within a node however, the validity of the assumption is limited since the processes communicate using shared memory, which also figures in computation by storing the application and its associated data structures. In this work, the limits of the said assumption's validity were tested, and it is shown that Extraneous Memory Accesses(EMAs) by a compute section could significantly slow down the communication operations following it. Two general observations were made in the course of this work: first, more EMAs cause greater slowdown; and second, EMAs coming from the compute section of the processes containing the MPI_Recv are more detrimental to communication performance than those coming from processes containing MPI_Send.

BibTeX - Entry

@InProceedings{tan_et_al:OASIcs:2012:3777,
  author =	{Wilson M. Tan and Stephen A. Jarvis},
  title =	{{Blurring the Computation-Communication Divide: Extraneous Memory Accesses and their Effects on MPI Intranode Communications}},
  booktitle =	{2012 Imperial College Computing Student Workshop},
  pages =	{135--141},
  series =	{OpenAccess Series in Informatics (OASIcs)},
  ISBN =	{978-3-939897-48-4},
  ISSN =	{2190-6807},
  year =	{2012},
  volume =	{28},
  editor =	{Andrew V. Jones},
  publisher =	{Schloss Dagstuhl--Leibniz-Zentrum fuer Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{http://drops.dagstuhl.de/opus/volltexte/2012/3777},
  URN =		{urn:nbn:de:0030-drops-37771},
  doi =		{10.4230/OASIcs.ICCSW.2012.135},
  annote =	{Keywords: High performance computing, Message passing, Multicore processing, Computer simulation, Computer networks, Parallel programming, Parallel processing}
}

Keywords: High performance computing, Message passing, Multicore processing, Computer simulation, Computer networks, Parallel programming, Parallel processing
Collection: 2012 Imperial College Computing Student Workshop
Issue Date: 2012
Date of publication: 09.11.2012

DROPS-Home | Fulltext Search | Imprint | Privacy Published by LZI