Close

Presentation

A Global In-Memory Cache and Computation Tier for DAOS
DescriptionThere are significant differences between emerging AI and data analytics workloads and traditional HPC workloads with regard to storage and programming frameworks. We extend DAOS with a queryable global shared low-latency/high-bandwidth cache and a resilient runtime that intercepts calls to popular analytics frameworks and offloads them to worker processes running on the HPC system. The result is a solution that offers bandwidth and latency benefits over vanilla DAOS and that enables ordinary programmers to interactively use popular programming frameworks like Python to solve huge problems on HPC systems without stranding resources.
Event Type
Workshop
TimeSunday, 17 November 202412:20pm - 12:25pm EST
LocationB309
Tags
Data Movement and Memory
I/O, Storage, Archive
Registration Categories
W