Presentation
Real-Time Scientific Data Streaming to HPC Nodes: Challenges and Innovations
DescriptionIn view of DOE’s Integrated Research Infrastructure (IRI), we are looking at a future where experimental or observational facilities routinely send their data to HPC for real-time computing to help steer experiments. Performance variability and latency introduced by buffering data on shared file systems is not acceptable for these multi-facility workflows — data should instead be streamed directly into HPC compute nodes over WAN.
This BoF will explore policies, strategies, and tools for direct, real-time streaming workflows in the HPC environment, aiming to raise awareness and foster a community effort to routinely and systematically support these workflows in the future.
This BoF will explore policies, strategies, and tools for direct, real-time streaming workflows in the HPC environment, aiming to raise awareness and foster a community effort to routinely and systematically support these workflows in the future.
Session Leader
Additional Session Leaders
