PyTorch Conference 2024: Full Schedule

September 18-19, 2024
San Francisco, California
View More Details & Registration
Note: The schedule is subject to change.

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for PyTorch Conference 2024 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Pacific Daylight Time (UTC-7). To see the schedule in your preferred timezone, please select from the drop-down located at the bottom of the menu to the right.

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

11:10am PDT

Lightning Talk: What’s New in Export? - Angela Yi, Tugsbayasgalan Manlaibaatar, Avik Chaudhuri & Yidi Wu, Meta

Wednesday September 18, 2024 11:10am - 11:20am PDT

Festival Pavilion - Breakout Room A

This talk discusses updates we've made to torch.export this past year: (a) Non-strict mode, an alternative tracing mode which in practice covers more programs than TorchDynamo without compromising important soundness guarantees (b) Better dynamic shapes specifications through generating suggested fixes and runtime assertions (c) Control flow operators such as cond, map, and associative scan (d) A shift in the export generated IR, which will enable both training and inference (e) An unflattener, which will reconstruct the eager module structure from the flattened exported graph

Speakers

Yidi WU

Research Scientist, Meta

I work on torch.export. Recently on front-end support of control flow operators/higher order operators.

Angela Yi

Software Engineer, Meta

I've been working on the PyTorch Compilers team for the past 2 years, mainly working on torch.export!

Avik Chaudhuri

Software Engineer, Meta

Creator of @flowtype. Machine learning explorer. Rusty programming language researcher. Amateur chef. Soccer dad. Website: https://avikchaudhuri.github.io/ Twitter: @__avik Blog: https://mathydad.wordpress.com/

Tugsbayasgalan Manlaibaatar

Software Engineer, Meta

I am a software engineer at Meta, working on PyTorch Compilers. I mainly work on the PT2 export workstream.

What’s new in torch.export .pptx pdf

Wednesday September 18, 2024 11:10am - 11:20am PDT
Festival Pavilion - Breakout Room A

Lightning Talks

Audience Intermediate

11:25am PDT

Lightning Talk: Low Precision Dtypes in PyTorch - Vasiliy Kuznetsov, Meta

Wednesday September 18, 2024 11:25am - 11:35am PDT

Festival Pavilion - Breakout Room A

This talk deep dives into the new native PyTorch float8 training library, and previews PyTorch's strategy for supporting upcoming low precision dtypes such as float6, float4 and MX for efficient training and inference.

Speakers

Vasiliy Kuznetsov

software engineer, Meta

Software Engineer, PyTorch Core

PTC 2024 Low Precision Dtypes in PyTorch pdf

Wednesday September 18, 2024 11:25am - 11:35am PDT
Festival Pavilion - Breakout Room A

Lightning Talks

Audience Advanced
Slides Attached Yes

11:40am PDT

ExecuTorch Beta and on-Device Generative AI Support - Mergen Nachin & Mengtao (Martin) Yuan, Meta

Wednesday September 18, 2024 11:40am - 12:05pm PDT

Festival Pavilion - Breakout Room A

During this session, we will discuss real-life case studies focusing on the productionization of PyTorch models onto edge devices and welcome the community to begin adopting ExecuTorch. Since announcing the ExecuTorch MVP at the previous PTC, we have made significant progress in terms of stability, model coverage, accelerator performance, and developer experience, reaching a milestone that marks the transition to beta status. In addition to the above improvements, we continue to support generative AI models. Since the alpha launch that initially enabled support for LLama2/3 models, we have now expanded our capabilities to include multimodal use cases and developed mobile demo apps showcasing these new features.

Speakers

Mengtao (Martin) Yuan

Tech Lead Manager, Meta

Mengtao (Martin) Yuan is a Tech Lead Manager in Meta’s PyTorch Edge team. With multiple years of experience in the AI industry, Mengtao is focused at building software systems to help AI researchers and engineers to deploy their models on edge devices such as mobile phones, AR/VR... Read More →

Mergen Nachin

Software Engineer, Meta

Mergen Nachin is a Software Engineer specializing in creating rich AI experiences on low latency, high performance, and privacy-aware embedded systems. With a background in distributed systems, developer infrastructure, remote sensing, and localization, he brings a versatile skill... Read More →

Talk 1 PTC ExecuTorch Beta and on Device Generative AI Support pdf

Wednesday September 18, 2024 11:40am - 12:05pm PDT
Festival Pavilion - Breakout Room A

Breakout Sessions

Audience Intermediate

2:10pm PDT

State of PyTorch - Ji Li & Damien Sereni, Meta

Wednesday September 18, 2024 2:10pm - 2:35pm PDT

Festival Pavilion - Breakout Room A

This talk gives a run through of who builds PyTorch, new and upcoming improvements to the framework and how to get involved. All thanks to our awesome community of contributors, partners and ecosystem tools.

Speakers

Ji Li

Data Scientist, Meta

Damien Sereni

Engineering director, Meta

[Final] State of PyTorch 2024 pdf

Wednesday September 18, 2024 2:10pm - 2:35pm PDT
Festival Pavilion - Breakout Room A

Breakout Sessions

Audience Any

2:40pm PDT

Sponsored Session: Accelerating AI Innovation: High Performance PyTorch at AMD - Robert Suderman & Ian Nordeng, AMD

Wednesday September 18, 2024 2:40pm - 3:05pm PDT

Festival Pavilion - Breakout Room A

Explore the powerful collaboration between AMD and PyTorch, driving advancements in AI and machine learning. Learn how AMD’s Day-0 PyTorch support delivers cutting-edge performance and seamless compatibility.

This session will highlight the technical synergies that make AMD hardware ideal choice for PyTorch frameworks, with real-world examples of accelerated workflows and breakthrough AI applications. Attendees will gain insights into how this dynamic partnership is enabling researchers, developers, and data scientists to push the boundaries of innovation and achieve unprecedented results in AI projects.

Speakers

Robert Suderman

Engineering Manager, AMD

Rob Suderman manages front-end support with AMD’s SHARK AI group with a goal of pushing tier one support for as many ML compute languages as possible. This has included core work on Torch-mlir, JAX, TOSA, and StableHLO, including being a founding team member on the IREE project... Read More →

Ian Nordeng

Manager Software Development, AMD

Ian Nordeng is a manager within AMD’s AIG-Sharks group where he spearheads machine learning model development for IREE’s compiler consumption to enable AI workloads to efficiently run across AMD’s hardware portfolio. He has been working in the AI compiler space for the past... Read More →

shark v2 Final 09.17.24 pdf

Wednesday September 18, 2024 2:40pm - 3:05pm PDT
Festival Pavilion - Breakout Room A

Breakout Sessions

Slides Attached Yes

3:10pm PDT

Lightning Talk: A Whirlwind Tour of PyTorch Extension Points - Alban Desmaison, Meta

Wednesday September 18, 2024 3:10pm - 3:20pm PDT

Festival Pavilion - Breakout Room A

Journey across the PyTorch stack and see all the extension points that exist from nn.Module to the c++ Dispatcher through autograd and subclasses. This sessions will cover example use cases and when each one should be used while pointing to reference for in-depth details.

Speakers

Alban Desmaison

Research Engineer, Meta

Alban has been working on PyTorch since nearly its inception, first during his PhD at the University of Oxford and now at Meta. He is focused on maintaining core components, designing a wide breadth of features and fostering the PyTorch Community.

A Whirlwind Tour of PyTorch Extension Points pdf

Wednesday September 18, 2024 3:10pm - 3:20pm PDT
Festival Pavilion - Breakout Room A

Lightning Talks

Audience Any

3:25pm PDT

Lightning Talk: Extending PyTorch with Custom Python/C++/CUDA Operators - Richard Zou, Meta

Wednesday September 18, 2024 3:25pm - 3:35pm PDT

Festival Pavilion - Breakout Room A

In this talk, we'll go over the new recommended APIs to extend PyTorch with custom Python/C++/CUDA operators. Users have been able to extend PyTorch with custom operators for years but we have updated our guidance for creating custom operators that compose with torch.compile, autograd, and other PyTorch subsystems.

Speakers

Richard Zou

Software Engineer, Meta

I'm a software engineer at Meta working on PyTorch. I'm one of the creators of functorch, JAX-like composable function transforms for PyTorch. Nowadays I spend my time working on torch.compile, figuring out how to add infra changes to make it easier for PyTorch features like custom... Read More →

PTC 2024 Extending PyTorch with Custom Operators pdf

Wednesday September 18, 2024 3:25pm - 3:35pm PDT
Festival Pavilion - Breakout Room A

Lightning Talks

Audience Intermediate
Slides Attached Yes

4:00pm PDT

Welcome to the PyTorch Ecosystem for LLM Fine-tuning Mini Summit - Kartikay Khandelwal, Meta

Wednesday September 18, 2024 4:00pm - 4:05pm PDT

Festival Pavilion - Breakout Room A

As open-source LLMs have become more capable, a substantial ecosystem has developed around the fine-tuning of these models. A thriving community of researchers, developers, practitioners and hobbyists has emerged which focuses on topics ranging from memory efficiency, parameter-efficient fine-tuning and quantization to performance at scale and reproducible evaluations. The goal of this mini-summit is to bring this community together to discuss ideas, share knowledge and build connections.

The agenda features a keynote from Joe Spisak on the state of the Llama ecosystem followed by invited talks from the founders of Axolotl, Unsloth and torchtune. We conclude the summit with a riveting discussion on what’s next for LLMs, fine-tuning and the PyTorch ecosystem with a fabulous panel of experts - Tim Dettmers (author of bitsandbytes and QLoRA), Hailey Schoelkopf (maintainer of LM Eval Harness at EleutherAI), Aakanksha Chowdhery (Lead author on PaLM and Gemini) and Alexis Conneau (Research Lead at OpenAI)

Speakers

Kartikay Khandelwal

Software Engineer, PyTorch, Meta

Kartikay Khandelwal is a software engineer in the PyTorch and AI Infra team at Meta where he leads the development of the PyTorch ecosystem for Generative AI, including open-source libraries like torchtune for LLM fine-tuning and torchchat for LLM inference. Prior to PyTorch, he worked... Read More →

Wednesday September 18, 2024 4:00pm - 4:05pm PDT
Festival Pavilion - Breakout Room A

Fine Tuning Mini-Summit

4:05pm PDT

The State of the Llama Ecosystem - Joe Spisak, Meta

Wednesday September 18, 2024 4:05pm - 4:15pm PDT

Festival Pavilion - Breakout Room A

Speakers

Joe Spisak

Product Director, Meta Inc.

Joe Spisak is Product Director and Head of Open Source in Meta’s Generative AI organization. A veteran of the AI space with over 10 years experience, Joe led product teams at Meta/Facebook, Google and Amazon where he focused on open source AI, open science and building developer... Read More →

Wednesday September 18, 2024 4:05pm - 4:15pm PDT
Festival Pavilion - Breakout Room A

Fine Tuning Mini-Summit

4:15pm PDT

The Challenges of Building an Opinionated Open Source LLM Framework - Wing Lian, Axolotl AI

Wednesday September 18, 2024 4:15pm - 4:25pm PDT

Festival Pavilion - Breakout Room A

Speakers

Wing Lian

Maintainer, Axolotl AI

Wing is the maintainer of Axolotl, focusing on improving the developer experience for finetuning.

The Challenges of Building an Opinionated Open Source LLM Fine tuning Framework (2) pdf

Wednesday September 18, 2024 4:15pm - 4:25pm PDT
Festival Pavilion - Breakout Room A

Fine Tuning Mini-Summit

4:25pm PDT

Hacks to Make LLM Training Faster - Daniel Han, Unsloth AI

Wednesday September 18, 2024 4:25pm - 4:35pm PDT

Festival Pavilion - Breakout Room A

Speakers

Daniel Han

Cofounder, Unsloth

I'm the algos guy behind Unsloth which makes finetuning 2x faster and use 70% less VRAM! I helped fix 8 bugs in Gemma, 3 bugs in Llama, a few in Mistral and Phi-3 and used to work at NVIDIA on making algos faster on GPUs! Had another OSS package Hyperlearn which was used by NASA... Read More →

Pytorch Conference Making LLM training faster pdf

Wednesday September 18, 2024 4:25pm - 4:35pm PDT
Festival Pavilion - Breakout Room A

Fine Tuning Mini-Summit

4:35pm PDT

torchtune: Easy and Accessible Finetuning in Native PyTorch - Evan Smothers, Meta

Wednesday September 18, 2024 4:35pm - 4:45pm PDT

Festival Pavilion - Breakout Room A

Speakers

Evan Smothers

Software Engineer, Meta

Evan is a software engineer on the PyTorch Domains team at Meta. He currently works on torchtune, a PyTorch library for memory-efficient fine-tuning of large language models. Prior to joining Meta, Evan worked as a data scientist at Uber and received his Ph.D. in mathematics from... Read More →

torchtune pdf

Wednesday September 18, 2024 4:35pm - 4:45pm PDT
Festival Pavilion - Breakout Room A

Fine Tuning Mini-Summit

Slides Attached Yes

4:45pm PDT

Panel Discussion - Tim Dettmers, AI2/Carnegie Melon; Hailey Schoelkopf, EleutherAI; Aakanksha Chowdhery, Meta; Alexis Conneau, OpenAI; Moderated by Kartikay Khandelwal, Meta

Wednesday September 18, 2024 4:45pm - 5:30pm PDT

Festival Pavilion - Breakout Room A

Moderators

Kartikay Khandelwal

Software Engineer, PyTorch, Meta

Speakers

Tim Dettmers

Research Scientist & Assistant Professor, Ai2 & Carnegie Mellon University

Tim Dettmers’s is a research scientist at AI2 and an incoming assistant professor at CMU. His research focuses on making foundation models, such as ChatGPT, accessible to researchers and practitioners by reducing their resource requirements. This involves developing novel compression... Read More →

Hailey Schoelkopf

EleutherAI

Hailey Schoelkopf is a Research Scientist at EleutherAI, a non-profit research lab focused on enabling open science on large-scale AI models. Her research has focused on building reproducible infrastructure for empowering open science on large-scale models, with core interests in... Read More →

Aakanksha Chowdhery

Research Scientist, Meta

Aakanksha has been a lead researcher in pre-training large language models, such as PaLM and Gemini. She led the 540B PaLM model at Google and was a core member of the Gemini, Pathways, PaLM-E and MedPaLM projects. Before Google, she led interdisciplinary teams at Microsoft Research... Read More →

Alexis Conneau

Member of Technical Staff, OpenAI

Alexis Conneau is a Member of Technical Staff at OpenAI in the Multimodal Frontiers team, where he has led the research for Audio+Text language modeling and the next-generation GPT4-o VoiceMode ("Her"). Prior to that, he was a research scientist at Facebook AI Research since 2015... Read More →

Wednesday September 18, 2024 4:45pm - 5:30pm PDT
Festival Pavilion - Breakout Room A

Fine Tuning Mini-Summit

10:50am PDT

Lightning Talk: d-Matrix LLM Compression Flow Based on Torch.Fx: Simplifying PTQ/QAT - Zifei Xu & Tristan Webb, d-Matrix Corporation

Thursday September 19, 2024 10:50am - 11:00am PDT

Festival Pavilion - Breakout Room A

We introduce dmx-compressor, d-Matrix's open-source LLM compression toolkit that is modular, robust, efficient, and user-friendly. It utilizes symbolic tracing and fx.Transformer for network compression while keeping the model a first-class citizen in PyTorch for the user, despite prevalent graph dynamism in LLMs. It achieves this by maintaining both the original nn.Module and a just-in-time (JIT) traced and transformed fx.GraphModule representation behind the scenes, in conjunction with an abstraction that cleanly decouples network compression from the original model graph definition. This design allows the FXIR to dynamically adapt to diverse forward call signatures and flow-control arguments throughout quantization-aware training and post-training quantization written in plain PyTorch, yielding a compressed FXIR fully compatible with application-level APIs like the Hugging Face pipeline. We also provide a graph visualizer based on fx.Interpreter for ease of debugging. We believe this project shall empower the community to build efficient LLMs for deployment on custom hardware accelerators and contribute to the PyTorch ecosystem.

Speakers

Zifei Xu

Senior Machine Learning Research Engineer, d-Matrix Corporation

Zifei is a Senior Machine Learning Research Engineer at d-Matrix. Her current work focuses on developing model quantization pipelines and efficient quantization algorithms. She graduated from Stanford University with a Master's degree in Computational & Mathematical Engineering and... Read More →

Tristan Webb

ML Engineer, d-Matrix

Tristan's background is primarily in computer science and mathematics, and which let him to graduate with a PhD in Complexity Science at the University of Warwick, where he worked with large computational neuroscience models of spiking neural networks using simulators written in C... Read More →

dmx compressor pdf

dmx Compressor Pytorch Conference pptx

Thursday September 19, 2024 10:50am - 11:00am PDT
Festival Pavilion - Breakout Room A

Lightning Talks

Audience Intermediate
Slides Attached Yes

11:05am PDT

Lightning Talk: LLMs on Edge with AI Accelerators - Chen Lai, Kimish Patel & Cemal Bilgin, Meta

Thursday September 19, 2024 11:05am - 11:15am PDT

Festival Pavilion - Breakout Room A

LLMs are known to be compute heavy and consume lots of resources (almost all resources on phones), including memory and power. A natural thought is to leverage the AI hardware accelerators, for example, Apple Neural Engine (ANE) on Apple devices and HTP on Qualcomm SoCs, to make it run fast and efficiently. Only by optimizing the model latency, memory consumption and power usage to a certain level will users be interested in installing the models on their devices. In this session, we’d like to introduce how we leverage these AI accelerators within the PyTorch ecosystem to achieve the state-of-art performance for llama3 on device, via ExecuTorch and the partnership with Apple and Qualcomm. Hardware companies usually have their own AI accelerators. Likely they have different characteristics, one may support a list of different operators than others, and one may only support static shapes (like HTP). However, transformers-based optimization can be generic. We’ll discuss in more detail how we apply the generic optimization as well as the backend specific optimization. The techniques we applied here are not just for LLMs, but can be applied to other transformer-based models.

Speakers

Kimish Patel

Software Engineer, Meta Platforms

Kimish has worked on enabling PyTorch on Meta's family of apps, primarily focusing on performance optimizations. His past experiences include hardware/software co-design, CPU architecture, and CPU/GPU performance optimization.

Chen Lai

Software Engineer, Meta

Software engineers focusing on bringing up accelerators on devices

CEMAL Bilgin

Engineering Manager, Meta

Engineering Manager PyTorch Edge Acceleration

LLMs on Edge with AI Accelerators pdf

Thursday September 19, 2024 11:05am - 11:15am PDT
Festival Pavilion - Breakout Room A

Lightning Talks

Audience Intermediate
Slides Attached Yes

11:20am PDT

Sponsored Session: Torchchat: A Showcase of PyTorch LLM Ubiquity - Jack Khuu & Jesse White, Meta

Thursday September 19, 2024 11:20am - 11:45am PDT

Festival Pavilion - Breakout Room A

This talk explores the journey of enabling LLMs in the PyTorch ecosystem, as well as how the teams behind AOT Inductor, ExecuTorch, and torchao collaborated to create torchchat, a showcase of PyTorch’s ability to run LLM inference everywhere.

Torchchat demonstrates the ubiquity, simplicity, and quality of PyTorch’s LLM support through performant, reproducible implementations for not only Python environments, but on desktop, server, and on-device as-well.

All of our work is open source and available on GitHub.

Speakers

Jack Khuu

Software Engineer, Meta

Software Engineer @ Meta working on the PyTorch Edge team. TL for torchchat, which is PyTorch's showcase of LLM inference ubiquity (Python, Desktops, Mobile, etc.). More broadly, I focus on the "Experience" of PyTorch Edge, encompassing User, Developer, and Community Experience.Ex-Lecturer... Read More →

Jesse White

Software Engineering Manager, Meta

Jesse is an engineering manager at PyTorch @ Meta, where he supports the Edge Experience team in improving the experience for on-device inference and training, including mobile, laptops, and embedded devices. With nearly 20 years of experience in startups, Jesse is passionate about... Read More →

torchchat pytorch conf24 pptx

Thursday September 19, 2024 11:20am - 11:45am PDT
Festival Pavilion - Breakout Room A

Breakout Sessions

Audience Intermediate
Slides Attached Yes

11:50am PDT

Lightning Talk: New Activation Checkpointing APIs in PyTorch - Jeffrey Wan & Horace He, Meta

Thursday September 19, 2024 11:50am - 12:00pm PDT

Festival Pavilion - Breakout Room A

Activation checkpointing is a commonly used technique to reduce memory usage during model training by reducing the number of activations saved for backward. Instead of keeping tensors needed for backward alive until they are used in gradient computation during backward, those tensors are recomputed during the backward pass. This talk will introduce new activation checkpoint APIs that can help achieve a better trade off between memory savings and compute overhead that recomputing introduces.

Speakers

Horace He

Software Engineer, Meta

To be filled

Jeffrey Wan

Software Engineer, Meta

Software Engineer working on PyTorch

New Activation Checkpointing APIs in PyTorch pdf

Thursday September 19, 2024 11:50am - 12:00pm PDT
Festival Pavilion - Breakout Room A

Lightning Talks

Audience Intermediate

12:00pm PDT

Lightning Talk: FlexAttention - The Flexibility of PyTorch + The Performance of FlashAttention - Yanbo Liang & Horace He, Meta

Thursday September 19, 2024 12:00pm - 12:10pm PDT

Festival Pavilion - Breakout Room A

Introducing a novel abstraction leveraging the PyTorch compiler stack to enable custom, user-defined attention mechanisms. This new API supports dynamic modifications to attention scores within SDPA, providing both runtime and memory efficiency through kernel fusion with the FlashAttention algorithm.

Speakers

Yanbo Liang

software engineer, Meta

I'm software engineer at PyTorch team working on torch.compile and LLM.

Horace He

Software Engineer, Meta

To be filled

Thursday September 19, 2024 12:00pm - 12:10pm PDT
Festival Pavilion - Breakout Room A

Lightning Talks

Audience Intermediate

12:10pm PDT

Lightning Talk: Making the Most of Heterogeneous Memory Capacity Using PyTorch - Syed Ahmed, NVIDIA Corporation

Thursday September 19, 2024 12:10pm - 12:20pm PDT

Festival Pavilion - Breakout Room A

Memory intensive deep learning workloads require efficient use of all kinds of memories that are available in a system. In this session, we will discuss how we can utilize such heterogeneous memory through memory pools in PyTorch. We will show how to mix-and-match different CUDA system allocators in the same PyTorch program using memory pools. Consequently, this API unlocks new use cases such as Extended GPU Memory (EGM) based all-gathers, Unified Virtual Memory (UVM), and NVLink Sharp (NVLS) reductions. New NVIDIA architectures accelerate such use cases with high-bandwidth and low-latency interconnects in the hardware, driven by extended functionality of CUDA system allocators in the software. Learn how to use these techniques on memory-intensive deep learning models like LLMs, and discover new CUDA features powered by PyTorch.

Speakers

Syed Ahmed

Senior Software Engineer, NVIDIA

Syed Ahmed is a Senior Software Engineer on the PyTorch Core team at NVIDIA, focused on keeping PyTorch fast and numerically stable on current NVIDIA platforms, and making PyTorch more expressive on future NVIDIA platforms. He holds a Master’s degree in Electrical Engineering from... Read More →

pytorch conference 2024 mempools pdf

Thursday September 19, 2024 12:10pm - 12:20pm PDT
Festival Pavilion - Breakout Room A

Lightning Talks

Audience Intermediate

2:15pm PDT

Data-Dependent Shapes in PT2 - Edward Yang, Meta

Thursday September 19, 2024 2:15pm - 2:40pm PDT

Festival Pavilion - Breakout Room A

Data-dependent shapes are ubiquitous whenever you want to take advantage of sparsity in your data representation, whether it is in recommendation systems, mixture of experts or other use cases. We have made a lot of improvements to torch.compile's support for capturing and compiling data dependent shapes, but they also require some user knowledge to work with effectively. This talk will give an overview of PT2's facilities for data dependent compute and how to use them effectively.

Speakers

Edward Z. Yang

Research Engineer, Meta

Edward Yang has worked on PyTorch at Meta since nearly the very beginning. Currently, he works on all aspects of PT2, but with a particular focus on dynamic shapes support across the stack.

Data dependent shapes in PT2 pdf

Thursday September 19, 2024 2:15pm - 2:40pm PDT
Festival Pavilion - Breakout Room A

Breakout Sessions

Audience Advanced

2:45pm PDT

Lightning Talk: What's New for PyTorch Developer Infrastructure - Sahan Paliskara & Catherine Lee, Meta

Thursday September 19, 2024 2:45pm - 2:55pm PDT

Festival Pavilion - Breakout Room A

Having a chat about all of the work being done to continue supporting PyTorch's Developer Infrastructure needs including updates around Target Determination, Releases, and OSS Tooling.

Speakers

Catherine Lee

Software Engineer, META

Software engineer on the PyTorch Dev Infra team primarily working on reducing time to signal, testing infrastructure, and CI related developer tooling.

Sahan Paliskara

Software Engineer, Meta

After spending a lot of time using PyTorch to train computer vision models, Sahan joined the PyTorch team three years ago. He started off working on inference and packaging, and now he's part of the dev infra team. These days, he's involved in everything from managing releases to... Read More →

2024 PyTorch Conference What's New in DevInfra pdf

Thursday September 19, 2024 2:45pm - 2:55pm PDT
Festival Pavilion - Breakout Room A

Lightning Talks

Audience Intermediate

3:00pm PDT

Lightning Talk: PyTorch Release Process - Andrey Talman, Meta

Thursday September 19, 2024 3:00pm - 3:10pm PDT

Festival Pavilion - Breakout Room A

I would like to present and quickly discuss PyTorch Release process, how it happens. What are milestones. What is our cherry-picking criteria, how we validate the release.

Speakers

Andrey Talman

Software Engineer, Meta Inc.

Software Engineer - Meta Inc. 2021-Present Part of PyTorch Dev Infra team. Working on PyTorch OSS Releases. Lead Software Engineer - Dow Jones & Company 2019-2021 Part of the team developing software and the API Services used by Dow Jones Factiva website and WSJ. Software Engineer... Read More →

PyTorch OSS Release Process pdf

Thursday September 19, 2024 3:00pm - 3:10pm PDT
Festival Pavilion - Breakout Room A

Lightning Talks

Audience Intermediate

3:15pm PDT

Torch.Compile for Autograd, DDP and FSDP - Will Feng , Chien-Chin Huang & Simon Fan, Meta

Thursday September 19, 2024 3:15pm - 3:40pm PDT

Festival Pavilion - Breakout Room A

In this talk, we will present the latest advancements in torch.compile for distributed training via DDP and FSDP. We will first introduce Compiled Autograd, a torch.compile mode to fully capture the backpropagation step, including the communication collective operators used in distributed. We will then cover the improvements this new approach brought to Compiled DDP/FSDP, notably by removing DDP/FSDP graph breaks which brings the potential of improving compute/communication overlap.

Speakers

Chien-Chin Huang

Software Engineer, Meta

Software Engineer, PyTorch Distributed, Meta

Simon Fan

Software Engineer, Meta

I'm a software engineer on the PyTorch Compiler team, I focus on torch.compile for distributed training frameworks.

Will Feng

Software Engineer, Meta Platforms, Inc.

Will Feng is a Software Engineer in PyTorch Compiler team at Meta. He has been working in PyTorch core and ecosystem for the past 7 years. He is now working on and most excited about torch.compile for distributed training performance.

PTC 2024 Torch.Compile for Autograd, DDP and FSDP pdf

Thursday September 19, 2024 3:15pm - 3:40pm PDT
Festival Pavilion - Breakout Room A

Breakout Sessions

Audience Intermediate

4:05pm PDT

Lightning Talk: Debiasing the Data Lifecycle - Shailvi Wakhlu, Shailvi Ventures LLC

Thursday September 19, 2024 4:05pm - 4:15pm PDT

Festival Pavilion - Breakout Room A

Biased data, results in biased decision-making. Making sure that at every step of the data lifecycle, we make conscious attempts to debias the data is an important responsibility for all data scientists. In this talk, I highlight the typical data lifecycle, and how to prevent biases at every step. ---- The key takeaways from my talk include: 1) Understanding the data lifecycle 2) What are the typical ways biases creep in 3) How we can proactively prevent and fix biases in data

Speakers

Shailvi Wakhlu

Founder, Shailvi Ventures LLC

Shailvi is a seasoned Data Leader and Self-Advocacy Expert with over sixteen years of experience building technology products. She has spoken at nearly 100 global conferences and Fortune 500 events, coached close to 500 individuals, and authored the best-selling book "Self-Advocacy... Read More →

Thursday September 19, 2024 4:05pm - 4:15pm PDT
Festival Pavilion - Breakout Room A

Lightning Talks

Audience Intermediate

4:20pm PDT

CANCELED: Lightning Talk: PyTorch-Wildlife: A Collaborative Deep Learning Framework for Conservation - Zhongqi Miao, Microsoft

Thursday September 19, 2024 4:20pm - 4:30pm PDT

Festival Pavilion - Breakout Room A

The alarming decline in global biodiversity, driven by various factors, underscores the urgent need for large-scale wildlife monitoring. To address these challenges, we introduce Pytorch Wildlife, an open-source deep learning platform built on PyTorch. It is designed for creating, modifying, and sharing powerful AI models. This platform emphasizes usability and accessibility, making it accessible to individuals with limited or no technical background. It also offers a modular codebase to simplify feature expansion and further development. Pytorch-Wildlife offers an intuitive, user-friendly interface, accessible through local installation or Hugging Face, for animal detection and classification in images and videos. As two real-world applications, Pytorch-Wildlife has been utilized to train animal classification models for species recognition in the Amazon Rainforest and for invasive opossum recognition in the Galapagos Islands. The Opossum model achieves 98% accuracy, and the Amazon model has 92% recognition accuracy for 36 animals in 90% of the data. As Pytorch-Wildlife evolves, we aim to integrate more conservation tasks, addressing various environmental challenges.

Speakers

Zhongqi Miao

Research Scientist, Microsoft

My research focus is AI (especially modern computer vision) applications in environmental science and ecology. I am currently in the AI for Good Lab, working on large-scale wildlife recognition through ground-based cameras (i.e., camera traps), bioacoustics, and overhead imagery... Read More →

Thursday September 19, 2024 4:20pm - 4:30pm PDT
Festival Pavilion - Breakout Room A

Lightning Talks

Audience Beginner

4:35pm PDT

Unlocking the Enigma: Crafting Unbiased, Transparent, and Explainable Large Language Models - Rashmi Nagpal, Patchstack

Thursday September 19, 2024 4:35pm - 5:00pm PDT

Festival Pavilion - Breakout Room A

In an era where artificial intelligence reigns supreme, the statistics are both perplexing and thought-provoking – only a mere 13% of large language models manage to transcend the realms of research and enter the practical world of production. Who bears the responsibility when these models err, spewing out biased or discriminatory outputs? It's time to demystify the complex landscape of machine learning ethics and carve a path towards a brighter, more accountable future! In this talk, firstly, we will navigate the profound impacts of large language models across diverse domains, from the lifesaving advances in medicine to safeguarding our nations through enhanced security protocols. Secondly, as we marvel at data-driven decisions laid by these models, we will confront the darker shadows cast by – the looming spectre of bias in the data. Finally, we will delve deep into the art of building interpretable models and navigating the maze of ethical considerations. Through a live demonstration in PyTorch, we will witness how to craft unbiased, transparent, and explainable models.

Speakers

Rashmi Nagpal

Machine Learning Engineer, Patchstack

Rashmi, a passionate researcher at the MIT CSAIL and machine learning engineer at Patchstack, is dedicated to crafting beautiful AI applications. With nearly 5 years of industrial experience, she has brought ideas to life at pre-seed startups and contributed to impactful redesigns... Read More →

PyTorch Conference Rashmi Nagpal.pptx pdf

Thursday September 19, 2024 4:35pm - 5:00pm PDT
Festival Pavilion - Breakout Room A

Breakout Sessions

Audience Intermediate
Slides Attached Yes

5:05pm PDT

The Ethical Implications of AI and the Environment: A Focus on Water - Amber Hasan, Ethical Tech AI & Senegal Tuklor Williams, Broken Pencil Pictures llc

Thursday September 19, 2024 5:05pm - 5:30pm PDT

Festival Pavilion - Breakout Room A

Artificial Intelligence (AI) has the potential to revolutionize various sectors, including environmental conservation and water management. However, the deployment of AI technologies raises ethical questions about the environmental impact, particularly water resources. This presentation will discuss the ethical implications of AI concerning water while also exploring how AI can both positively and negatively affect water resources along with the broader ecosystem. My goal is to facilitate a critical conversation around how to balance technological advancements with environmental stewardship. Objectives: Understanding Ethical Implications: Provide an in depth overview of how AI impacts water resources. Focus on ethical concerns related to AI's water footprint, including, but not limited to energy consumption and water usage in data centers. Explore Positive Applications: Talk about the possible successful implementations of AI in water conservation, pollution monitoring, and efficient resource management. Discuss potential future applications where AI could contribute to sustainable water management and connect stakeholders to address ethical concerns and solutions.

Speakers

Amber Hasan

Owner, Ethical Tech AI

Amber Hasan is an interdisciplinary artist and community organizer focused on using Creative Practice as a tool for change. Amber is Co-Founder of The Sister Tour collective, she has worked with photographer LaToya Ruby Frazier regarding the Flint Water Crisis, she is a Board Member... Read More →

Senegal Tuklor Williams

C.O.O., ETHICAL TECH AI

From the standpoint of Broken Pencil Pictures, we are a dynamic and multi-disciplinary creative cil company. Our achievements are a testament to our dedication to social change and the betterment of our community. "The Sister Tour" stands out as an initiative through which we distributed... Read More →

Thursday September 19, 2024 5:05pm - 5:30pm PDT
Festival Pavilion - Breakout Room A

Breakout Sessions

Audience Any