Re-examining Scheduling and Communication in Parallel Programs

Andrea C. Dusseau, Remzi H. Arpaci and David E. Culler

EECS Department
University of California, Berkeley
Technical Report No. UCB/CSD-95-881
1995

http://www2.eecs.berkeley.edu/Pubs/TechRpts/1995/CSD-95-881.pdf

Modern MPPs and NOWs have evolved in ways that affect both the scheduling of parallel applications as well as the communication layer. The presence of a full operating systems upon each processor as well as the need to support interactive users substantially alter the traditional environment. Parallel applications may no longer be executing in the dedicated environment that fast communication layers, such as Active Messages, assume. In this paper we present a simulation-based study of the effects of a non-dedicated environment on parallel applications and investigate one method for reducing the resulting performance impact.

Our results quantify the performance impact of the size of the flow-control window on parallel applications. We investigate increasing the size of this window to ameliorate the effect of various scheduling disturbances. Our results show that additional buffering in the communication layer significantly improves performance in the presence of large scheduling irregularities (e.g., those that occur when parallel applications are locally scheduled) but has a detrimental effect with smaller disturbances (e.g., quantum skew, daemon activity, and interactive users).


BibTeX citation:

@techreport{Dusseau:CSD-95-881,
    Author = {Dusseau, Andrea C. and Arpaci, Remzi H. and Culler, David E.},
    Title = {Re-examining Scheduling and Communication in Parallel Programs},
    Institution = {EECS Department, University of California, Berkeley},
    Year = {1995},
    URL = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/1995/6010.html},
    Number = {UCB/CSD-95-881},
    Abstract = {Modern MPPs and NOWs have evolved in ways that affect both the scheduling of parallel applications as well as the communication layer. The presence of a full operating systems upon each processor as well as the need to support interactive users substantially alter the traditional environment. Parallel applications may no longer be executing in the dedicated environment that fast communication layers, such as Active Messages, assume. In this paper we present a simulation-based study of the effects of a non-dedicated environment on parallel applications and investigate one method for reducing the resulting performance impact. <p>Our results quantify the performance impact of the size of the flow-control window on parallel applications. We investigate increasing the size of this window to ameliorate the effect of various scheduling disturbances. Our results show that additional buffering in the communication layer significantly improves performance in the presence of large scheduling irregularities (e.g., those that occur when parallel applications are locally scheduled) but has a detrimental effect with smaller disturbances (e.g., quantum skew, daemon activity, and interactive users).}
}

EndNote citation:

%0 Report
%A Dusseau, Andrea C.
%A Arpaci, Remzi H.
%A Culler, David E.
%T Re-examining Scheduling and Communication in Parallel Programs
%I EECS Department, University of California, Berkeley
%D 1995
%@ UCB/CSD-95-881
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/1995/6010.html
%F Dusseau:CSD-95-881