PyTorch Conference 2024

Attending this event?

PyTorch Conference 2024

September 18-19, 2024
San Francisco, California
View More Details & Registration
Note: The schedule is subject to change.

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for PyTorch Conference 2024 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Pacific Daylight Time (UTC-7). To see the schedule in your preferred timezone, please select from the drop-down located at the bottom of the menu to the right.

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

8:30am PDT

Registration & Badge Pick-Up Gateway Pavilion - Foyer

9:00am PDT

Keynote: Welcome Back & Opening Remarks Festival Pavilion - Keynote Room

9:07am PDT

Keynote: Why You Should Think Twice Before Paying for an Evaluation Tool - Chip Huyen, VP of AI & OSS, Voltron Data Festival Pavilion - Keynote Room

9:24am PDT

Keynote: Navigating the Architectural Timeline of LLMs - Sebastian Raschka, Staff Research Engineer, Lightning AI Festival Pavilion - Keynote Room

9:41am PDT

Keynote: Building an Advanced Knowledge Assistant - Jerry Liu, Co-Founder & CEO, LlamaIndex Festival Pavilion - Keynote Room

9:58am PDT

Keynote: Ray: A Distributed Framework for Heterogeneous Computing - Ion Stoica, Professor, UC Berkeley Festival Pavilion - Keynote Room

10:15am PDT

Keynote: Contributor Awards Festival Pavilion - Keynote Room

10:25am PDT

Coffee Break Gateway Pavilion - Sponsor Showcase Sponsor Showcase Gateway Pavilion - Sponsor Showcase

10:50am PDT

Lightning Talk: d-Matrix LLM Compression Flow Based on Torch.Fx: Simplifying PTQ/QAT - Zifei Xu & Tristan Webb, d-Matrix Corporation Festival Pavilion - Breakout Room A Sponsored Session: Democratizing AI: Powering the Future with Arm’s Global Compute Ecosystem - Gian Marco Iodice, Arm Gateway Pavilion - Cowell Theater The Rise of `Transformers` in the Growing PyTorch Ecosystem - Arthur Zucker, Hugging Face Festival Pavilion - Breakout Room B

11:05am PDT

Lightning Talk: LLMs on Edge with AI Accelerators - Chen Lai, Kimish Patel & Cemal Bilgin, Meta Festival Pavilion - Breakout Room A

11:20am PDT

Lightning Talk: Building and Supporting the Chinese PyTorch Community: Resources, Tutorials, and Engagement - Zong Zesheng, Huawei Gateway Pavilion - Cowell Theater Sponsored Session: Torchchat: A Showcase of PyTorch LLM Ubiquity - Jack Khuu & Jesse White, Meta Festival Pavilion - Breakout Room A Training MoEs at Scale with PyTorch - Mihir Patel & Brian Chu, Databricks Festival Pavilion - Breakout Room B

11:35am PDT

Lightning Talk: Distributing a Million Open Models in the Wild: Lessons Learned from the Hugging Face Hub - Omar Sanseviero, Hugging Face Gateway Pavilion - Cowell Theater

11:50am PDT

Lightning Talk: Empowering Developers: Tools and Resources for Running Generative AI on Arm CPUs - Pareena Verma, Arm Festival Pavilion - Breakout Room B Lightning Talk: New Activation Checkpointing APIs in PyTorch - Jeffrey Wan & Horace He, Meta Festival Pavilion - Breakout Room A Lightning Talk: Understanding and Optimizing PyTorch Models with Thunder - Luca Antiga, Lightning AI Gateway Pavilion - Cowell Theater

12:00pm PDT

Lightning Talk: Fast, Scalable Distributed Training with StreamingDataset - Saaketh Narayan, Databricks Gateway Pavilion - Cowell Theater Lightning Talk: FlexAttention - The Flexibility of PyTorch + The Performance of FlashAttention - Yanbo Liang & Horace He, Meta Festival Pavilion - Breakout Room A Lightning Talk: Optimized PyTorch Inference on aarch64 Linux CPUs - Sunita Nadampalli, Amazon (AWS) Festival Pavilion - Breakout Room B

12:10pm PDT

Lightning Talk: AOTriton: Ahead of Time Triton Kernel Libraries on ROCm - Jeff Daily, AMD Festival Pavilion - Breakout Room B Lightning Talk: Implementing and Using Iterable Datasets: What Could Go Wrong? - Nicolas Hug, Meta Gateway Pavilion - Cowell Theater Lightning Talk: Making the Most of Heterogeneous Memory Capacity Using PyTorch - Syed Ahmed, NVIDIA Corporation Festival Pavilion - Breakout Room A

12:25pm PDT

Lunch (Provided Onsite for All Attendees) Gateway Pavilion - Sponsor Showcase

1:25pm PDT

Sponsored Keynote: Accelerating AI: How AMD and PyTorch Drive Innovation with Seamless Day-0 Support and High Performance - Anush Elangovan, CVP Software Development, AMD Festival Pavilion - Keynote Room

1:32pm PDT

Sponsored Keynote: Optimizing AI Inference for Large Language Models - Mudhakar Srivatsa, Distinguished Engineer, IBM Festival Pavilion - Keynote Room

1:40pm PDT

Keynote Panel Discussion: Scaling & Benchmarking - Anastasios Nikolas Angelopoulos, UC Berkeley/LMSYS; Lisa Dunlap, UC Berkeley; James Bradbury, Anthropic; Tri Dao, together.ai; Aparna Ramani & Soumith Chintala... Festival Pavilion - Keynote Room

2:15pm PDT

Building PyTorch Computer Vision Algorithms for 100 Skin Shades - Emmanuel Acheampong, roboMUA Gateway Pavilion - Cowell Theater Data-Dependent Shapes in PT2 - Edward Yang, Meta Festival Pavilion - Breakout Room A vLLM: Easy, Fast, and Cheap LLM Serving for Everyone - Woosuk Kwon & Xiaoxuan Liu, UC Berkeley Festival Pavilion - Breakout Room B

2:45pm PDT

Lightning Talk: What's New for PyTorch Developer Infrastructure - Sahan Paliskara & Catherine Lee, Meta Festival Pavilion - Breakout Room A Blobs to Clips: Efficient End-to-End Video Data Loading - Andrew Ho & Ahmad Sharif, Meta Gateway Pavilion - Cowell Theater Torchtitan: Large-Scale LLM Training Using Native PyTorch 3D Parallelism - Wanchao Liang, Meta & Linsong Chu, IBM Research Festival Pavilion - Breakout Room B

3:00pm PDT

Lightning Talk: PyTorch Release Process - Andrey Talman, Meta Festival Pavilion - Breakout Room A

3:15pm PDT

Slaying OOMs - Mark Saroufim & Jane Xu, Meta Festival Pavilion - Breakout Room B Sponsored Session: PyTorch Support by Google Enabling Performance from Cloud to Edge - Mark Sherwood & Shauheen Zahirazami, Google Gateway Pavilion - Cowell Theater Torch.Compile for Autograd, DDP and FSDP - Will Feng , Chien-Chin Huang & Simon Fan, Meta Festival Pavilion - Breakout Room A

3:40pm PDT

Coffee Break Gateway Pavilion - Sponsor Showcase

3:45pm PDT

Sponsor Scavenger Hunt Raffle Drawing Gateway Pavilion - Sponsor Showcase

4:05pm PDT

Lightning Talk: Debiasing the Data Lifecycle - Shailvi Wakhlu, Shailvi Ventures LLC Festival Pavilion - Breakout Room A Understanding the LLM Inference Workload - Mark Moyou, NVIDIA Festival Pavilion - Breakout Room B Startup Showcase Gateway Pavilion - Cowell Theater

4:20pm PDT

CANCELED: Lightning Talk: PyTorch-Wildlife: A Collaborative Deep Learning Framework for Conservation - Zhongqi Miao, Microsoft Festival Pavilion - Breakout Room A

4:35pm PDT

Intel GPU in Upstream PyTorch: Expanding GPU Choices and Enhancing Backend Flexibility - Eikan Wang & Min Jean Cho, Intel Festival Pavilion - Breakout Room B Unlocking the Enigma: Crafting Unbiased, Transparent, and Explainable Large Language Models - Rashmi Nagpal, Patchstack Festival Pavilion - Breakout Room A

5:05pm PDT

Implementing a Custom Torch.Compile Backend - A Case Study - Maanav Dalal & Yulong Wang, Microsoft Festival Pavilion - Breakout Room B The Ethical Implications of AI and the Environment: A Focus on Water - Amber Hasan, Ethical Tech AI & Senegal Tuklor Williams, Broken Pencil Pictures llc Festival Pavilion - Breakout Room A

5:30pm PDT

The PyTorch Flare Party Sponsored by Hugging Face Gateway Pavilion - Sponsor Showcase