BEGIN:VCALENDAR
VERSION:2.0
PRODID:Linklings LLC
BEGIN:VTIMEZONE
TZID:America/New_York
X-LIC-LOCATION:America/New_York
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:19700308T020000
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:19701101T020000
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTAMP:20250626T234543Z
LOCATION:B302-B305
DTSTART;TZID=America/New_York:20241119T120000
DTEND;TZID=America/New_York:20241119T170000
UID:submissions.supercomputing.org_SC24_sess487_post196@linklings.com
SUMMARY:Turbocharging Dask Apps: Accelerating Data Flow with ProxyStore
DESCRIPTION:Klaudiusz Rydzy (Loyola University, Chicago)\n\nDespite advanc
 ements in distributed computing libraries, performance challenges, such as
  data serialization and transfer, still persist. We focus on understanding
  data limitations within Dask, a versatile and popular Python library desi
 gned for distributed and parallel computing, and then investigate the pote
 ntial of using the pass-by-proxy paradigm implemented by ProxyStore to add
 ress these inefficiencies. By integrating ProxyStore, we streamline data f
 low in Dask applications, reducing overheads associated with data serializ
 ation and scheduler overheads. \nOur approach evaluates the impact of prox
 ies on data transfer times and overall computational efficiency. We find t
 hat our integration reduces task overheads by 5-6x on a real machine learn
 ing application.\n\nRegistration Category: Tech Program Reg Pass, Exhibits
  Reg Pass\n\nSession Chairs: Ayesha Afzal (Friedrich-Alexander University,
  Erlangen-Nuremberg; Erlangen National High Performance Computing Center);
  Sally Ellingson (University of Kentucky); and Alan Sussman (University of
  Maryland)\n\n
END:VEVENT
END:VCALENDAR