Loading…
Attending this event?
September 18-19, 2024
San Francisco, California
View More Details & Registration
Note: The schedule is subject to change.

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for PyTorch Conference 2024 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Pacific Daylight Time (UTC-7). To see the schedule in your preferred timezone, please select from the drop-down located at the bottom of the menu to the right.

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

← Back to schedule
Blobs to Clips: Efficient End-to-End Video Data Loading - Andrew Ho & Ahmad Sharif & Gokul Gunasekaran, Meta; Kaiyue Yang, Meta Platforms, Inc
Thursday September 19, 2024 2:30pm - 2:55pm PDT
Room C
The PyTorch team has improved training speed by an order of magnitude for teams at Meta working on Small-to-Large-Scale MultiModal Video models. In this talk we’ll share our learnings on reducing GPU starvation by overcoming data loading challenges such as dealing with large distributed datasets, worker imbalance, compute-bottlenecks due to parallel video decoding and sampling, checkpointing, and debuggability. As part of our commitment to open-source, we are releasing a new decoding library and updating existing PyTorch libraries on GitHub, and invite feedback and contributions from the community.
Speakers
avatar for Ahmad Sharif

Ahmad Sharif

Software Engineer, Meta
SWE in Pytorch Content Domains Past: SWE at Google in Search, Privacy, ChromeOS
avatar for Andrew Ho

Andrew Ho

Mr, Meta
We are ML Engineers at Meta on PyTorch working on multi-modal LLM dataloading
avatar for Gokul Gunasekaran

Gokul Gunasekaran

Software Engineer, Meta
Gokul is a Software engineer working in PyTorch team in Meta focusing on dataloading challenges in large scale CU and GenAI training workloads. In the past he was working on scaling backend services handling Meta-scale live streams and video uploads.
avatar for Kaiyue Yang

Kaiyue Yang

Software Engineer, Meta Platforms, Inc
Kaiyue is a software engineering at Meta Platforms, Inc, where he works at Pytorch Domains team and focus on building infra solutions for large-scale ML training and inference.
Thursday September 19, 2024 2:30pm - 2:55pm PDT
Room C
  Breakout Sessions

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Share Modal

Share this link via

Or copy link