Presentation
Managing Memory Heterogeneity in HPC
DescriptionMemory heterogeneity refers to the memory architecture with multiple memory components with diverse characteristics (such as latency and bandwidth). It is common to see heterogeneous memory (HM) in supercomputers nowadays. With the emergence of processing-in-memory and resource disaggregation, there will be more memory components with increasingly different features. Managing HM is challenging. The programmer often has to take care of memory allocation, decide data placement and migration, and make the best use of fast memory in HM. HM also introduces complexity in programming models, and introduces new performance bugs. We will discuss how memory heterogeneity will impact the HPC ecosystem.
