Presentation
A Study of a Deterministic Networking Framework for Latency Critical Large Scientific Data Transfers
SessionThe 11th Annual International Workshop on Innovating the Network for Data Intensive Science - INDIS
DescriptionScientific workflows often involve large data transfers, which increasingly require completion-time guarantees. To support these time-sensitive flows, the Energy Science Network (ESnet) has implemented on-demand circuits with packet priority, allowing the circuit to be utilized by other traffic when the deadline-sensitive flow is inactive. We explore a deterministic networking framework designed to support large scientific data transfers with completion guarantees. We consider an ideal network where all nodes are time-synchronized and utilize Cyclic Queueing and Forwarding (CQF) to achieve reliable low-latency data transfers. Our results show that the deterministic network architecture achieves performance comparable to the dynamic bandwidth reservation scheme. We believe that a more optimized version of the time-sensitive networking protocol that exploit multi-path routing could offer better completion guarantees than traditional network reservation options while improving overall network bandwidth utilization.
Event Type
Workshop
TimeMonday, 18 November 202412:24pm - 12:30pm EST
LocationB305
Architecture
Data-Intensive
Network
Performance Optimization
System Administration
W
Archive
view