Presentation
SIGN IN TO VIEW THIS PRESENTATION Sign In
Towards Performance Portability on Cloud Clusters: Lessons Learned from Benchmarking MPI Applications
DescriptionCloud-based HPC empowers practitioners with more flexibility than traditional on-premise systems; on-demand, customizable compute resources can be placed close to big data, thus minimizing I/O bottlenecks and allowing users to explore cutting-edge hardware. However, deploying HPC applications to different environments while also maintaining the same performance is a significant barrier to the community. Here, we discuss an approach for automating application and performance portability that is based on infrastructure as code provisioning of cloud clusters coupled with “compute environment as code” for configuring package managers and containerized applications to fully utilize cloud resources. We benchmark two common MPI applications across different cloud service providers. For each case, we present how some lessons learned and our best practices at several different levels within this HPC stack, including the configuration of high performance networking and storage options, has enabled both application and performance portability.
Presenter
