The irregular computing model is being utilized by a number of emerging applications in domains such as chemistry, bioinfomatics, and data analytics. Unlike the well-studied Bulk Synchronous Parallel (BSP) model, the irregular model is usually characterized by unpredictable and fine-grained data access. As the most widely used communication model over distributed memory systems, MPI defines the nonblocking message passing as well as the one-sided communication for the semantic support of irregular and asynchronous data access. The runtime implementation, however, still cannot take over such data movement efficiently.
In this talk, we analyze the crucial communication issues existing in irregular computing and present the techniques for enabling a dynamic communication environment. Through the case study of a large quantum chemistry application, we discover that the performance bottlenecks in communication are usually caused by static resource assignment for communication progress and computation. As the MPI-level solution, we first present a flexible and adaptive progress resource management for complex multiphase applications. We then further exploit a low-level multiprocess execution model that enables VAS sharing with privatized variable sets. This model allows MPI to share arbitrary information among MPI tasks, thus enabling fully dynamic resource sharing and scheduling.
Dr. Min Si is an Assistant Computer Scientist in the Mathematics and Computer Science Division of Argonne National Laboratory. Min was previously an Enrico Fermi Postdoctoral Scholar at Argonne, and received her Ph.D. and master’s degree in computer science from the University of Tokyo in 2016 and 2012, respectively. Min’s research interests include communication runtime in high-performance computing and parallel programming models. Min is the recipient of the 2018 IEEE TCHPC Early Career Researchers Award for Excellence in High Performance Computing, and won the Karsten Schwan Best Paper Award at HPDC 2018.
Tuesday, December 4, 2018 at 11:15am to 12:15pm
Love Building (LOV), 151
1017 Academic Way, Tallahassee, FL