BEGIN:VCALENDAR
VERSION:2.0
PRODID:Linklings LLC
BEGIN:VTIMEZONE
TZID:America/New_York
X-LIC-LOCATION:America/New_York
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:19700308T020000
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:19701101T020000
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTAMP:20260422T143139Z
LOCATION:B302
DTSTART;TZID=America/New_York:20241118T120700
DTEND;TZID=America/New_York:20241118T123000
UID:submissions.supercomputing.org_SC24_sess756_ws_worksp112@linklings.com
SUMMARY:Enabling Low-Overhead HT-HPC Workflows at Extreme Scale using GNU 
 Parallel
DESCRIPTION:Ketan Maheshwari (Oak Ridge National Laboratory (ORNL)); Willi
 am Arndt (Lawrence Berkeley National Laboratory (LBNL)); and Ahmad Maroof 
 Karimi, Junqi Yin, Frederic Suter, Seth Johnson, and Rafael Ferreira da Si
 lva (Oak Ridge National Laboratory (ORNL))\n\nGNU Parallel is a versatile 
 and powerful tool for process parallelization widely used in scientific co
 mputing. This paper demonstrates its effective application in high-perform
 ance computing (HPC) environments, particularly focusing on its scalabilit
 y and efficiency in executing large-scale high-throughput high-performance
  computing (HT-HPC) workflows. Through real-world examples, we highlight G
 NU Parallel's performance across various HPC workloads, including GPU comp
 uting, container-based workloads, and node-local NVMe storage. Our results
  on two leading supercomputers, OLCF's Frontier and NERSC's Perlmutter, sh
 owcase GNU Parallel's rapid process dispatching ability and its capacity t
 o maintain low overhead even at extreme scales. We explore GNU Parallel's 
 application in massive parallel file transfers using a scheduled Data Tran
 sfer Node (DTN) cluster, emphasizing its broad utility in diverse scientif
 ic workflows. GNU Parallel can be employed in conjunction with other workf
 low systems as a "last-mile" parallelizing driver and as a quick prototypi
 ng tool to design and extract parallel profiles from application execution
 s.\n\nTag: Applications and Application Frameworks, Distributed Computing,
  Middleware and System Software\n\nRegistration Category: Workshop Reg Pas
 s\n\nSession Chairs: Silvina Caino-Lores (National Institute for Research 
 in Digital Science and Technology (Inria)) and Anirban Mandal\n\n
END:VEVENT
END:VCALENDAR