Presentation
A software Ecosystem for Multi-Level Provenance Management in Large-Scale Scientific Workflows for AI Applications
DescriptionScientific workflows and provenance are two faces of the same medal. While the former addresses the coordinated execution of multiple tasks over a set of computational resources, the latter relates to the historical record of data from its original sources. This paper highlights the importance of tracking multi-level provenance metadata in complex, AI-based scientific workflows as a way to (i) foster and (ii) expand documentation of experiments, (iii) enable reproducibility, (iv) address interpretability of the results, (v) facilitate performance bottlenecks diagnosis, and (vi) advance provenance exploration and analysis opportunities.
Author/Presenters
Event Type
Workshop
TimeMonday, 18 November 20249:14am - 9:37am EST
LocationB302
Applications and Application Frameworks
Distributed Computing
Middleware and System Software
W
Archive
view