Presentation
Leveraging Open Standardized Object-Based Computational Storage to Boost HPC Data Analytics
DescriptionOpen standardizing — like NFS sets, NAS protocols, and ANSI T10 — defines SCSI’s object-based storage device (OSD) command sets and facilitates interoperability, community support, and vendor neutrality. We propose a standardized object-based computational storage (OCS) system amid the growing usage of object storage, the increasing bottlenecks from excessive data movement, the absence of standardization for data reduction functions within storage, and changing from SCSI interface to NVMe. The OCS, as a result of the collaboration with Los Alamos National Laboratory, performs computation in the storage itself and reduces data movement by transmitting only the results of the computation. This system supports a high-level OCS interface for object management and query pushdown, alongside a low-level OCS device (OCSD) command set for device-level object store and query processing. This talk will discuss the rationale behind OCS architecture, its integration with existing analytics systems, current prototype implementation, and early analytics acceleration results based on real-world HPC workloads.
Presenter
Event Type
Exhibitor Forum
TimeTuesday, 19 November 20244:30pm - 5pm EST
LocationB206
I/O, Storage, Archive
TP
XO/EX
Archive
view