Presentation
I/O Characterization of Heterogeneous Workflows
DescriptionWorkflows consist of individual applications such as scientific simulations and data analytics. These applications constitute different stages of the workflow, each comprising heterogeneous characteristics such as run-times and system requirements. The heterogeneity in these workflow stages dictates the need to efficiently characterize them in terms of I/O to provide insights that can lead to informed decisions for their optimization. In this work we have analyzed the run-times of the workflows Montage, 1000 Genome and MuMMI and have categorized their stages as I/O or Non-I/O bound. For the I/O bound stages we perform a detailed analysis of their bandwidth and resource requirements. Our findings conclude that Montage's mBgModel could benefit from Dynamic Resource Scheduling, while Genome's individuals_merge could benefit from data aggregations in the PFS requests and the usage of isolated storage solutions such as node-local storage. These optimizations could aid in serving the bandwidth requirements of this workflow stage.
Event Type
ACM Student Research Competition: Graduate Poster
ACM Student Research Competition: Undergraduate Poster
Doctoral Showcase
Posters
TimeTuesday, 19 November 202412pm - 5pm EST
LocationB302-B305
TP
XO/EX