Name: Lightning Talk: PyTorch/XLA Auto-Sharding - Yeounoh Chung, Google
Start: 2024-09-19T17:05:00-0700
End: 2024-09-19T17:15:00-0700

September 18-19, 2024
San Francisco, California
View More Details & Registration
Note: The schedule is subject to change.

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for PyTorch Conference 2024 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Pacific Daylight Time (UTC-7). To see the schedule in your preferred timezone, please select from the drop-down located at the bottom of the menu to the right.

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

Thursday September 19, 2024 5:05pm - 5:15pm PDT

Room A

PyTorch/XLA recently launched the new PyTorch/XLA SPMD feature as a first-step to automate ML workloads parallelization using GSPMD. It turns out that the performance largely depends on the quality of sharding hints provided by the user – and it requires a correct and deep understanding of model architectures and much expertise to come up with optimal sharding hints. To address this problem, we propose to integrate PyTorch/XLA SPMD with XLA's auto sharding service that allows the XLA compiler to shard and optimize the whole model without any user input.

Speakers

Yeounoh Chung

Software Engineer, Google

SystemsResearch@Google

Thursday September 19, 2024 5:05pm - 5:15pm PDT
Room A

Lightning Talks

Audience Intermediate

PyTorch Conference 2024

Yeounoh Chung

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!