Name: Lightning Talk: In-Transit Machine Learning Using PyTorch on Frontier Exascale System - Vineeth Gutta, University of Delaware
Start: 2024-09-18T16:15:00-0700
End: 2024-09-18T16:25:00-0700

September 18-19, 2024
San Francisco, California
View More Details & Registration
Note: The schedule is subject to change.

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for PyTorch Conference 2024 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Pacific Daylight Time (UTC-7). To see the schedule in your preferred timezone, please select from the drop-down located at the bottom of the menu to the right.

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

Wednesday September 18, 2024 4:15pm - 4:25pm PDT

Gateway Pavilion - Cowell Theater

Traditional ML workflows use offline training where the data is stored on disk and is subsequently loaded into accelerator (CPU,GPU, etc) memory during training or inference. We recently devised a novel and scalable in-transit ML workflow for a plasma-physics application (chosen as 1 out of 8 compelling codes in the country) for the world’s fastest supercomputer, Frontier) with an aim to build a high-energy laser particle accelerator. Data generated in distributed HPC systems like Frontier create volumes of data that is infeasible to store on HPC file systems. A mismatch between modern memory hierarchies occurs due to high volume and rate of data generation. Our novel ML workflow utilizes continuous learning where the data is consumed in batches as the simulation produces the data and then discards after each batch is trained. This in-transit workflow integrates particle-in-cell simulations with distributed ML training on PyTorch using DDP allows for an application coupling enabling the model to learn correlations between emitted radiation and particle dynamics within simulation in an unsupervised method. This workflow is demonstrated at scale on Frontier using 400 AMD MI250X GPUs

Speakers

Vineeth Gutta

PhD Student, University of Delaware

Vineeth is a fifth-year PhD student in the department of Computer and Information Sciences at the University of Delaware. He is a member of the Computational Research and Programming Lab (CRPL) and is advised by Dr. Sunita Chandrasekaran. His research interests lie at the intersection of High Performance Computing and Machine Learning. He works with the National Cancer Institute (NCI/NIH) on improving drug response and drug discovery models. Currently working on improving the AMPL model that predicts binding free energy of ligand-protein dock... Read More →

pytorch conf24 ppt final pdf

Wednesday September 18, 2024 4:15pm - 4:25pm PDT
Gateway Pavilion - Cowell Theater

Lightning Talks

Audience Advanced

PyTorch Conference 2024

Vineeth Gutta

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!