Name: Running State-of-Art Gen AI Models on-Device with NPU Acceleration - Felix Baum, Qualcomm
Start: 2024-09-18T14:25:00-0700
End: 2024-09-18T14:50:00-0700

September 18-19, 2024
San Francisco, California
View More Details & Registration
Note: The schedule is subject to change.

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for PyTorch Conference 2024 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Pacific Daylight Time (UTC-7). To see the schedule in your preferred timezone, please select from the drop-down located at the bottom of the menu to the right.

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

Wednesday September 18, 2024 2:25pm - 2:50pm PDT

Room B

Since the boom of generative AI, the industry is now moving towards on-device AI inferencing, as it is not only a trend but a necessity now in order to save costs, achieve the best inference performance, ultra-low latency at the lowest power possible. In this session we go over the new features added on the Qualcomm AI Stack and how it works with the public release of ExecuTorch 1.0. We will discuss how to run traditional workloads as well as GenAI use cases including the latest version of Llama on the Mobile device while using Qualcomm Hexagon NPU.

Speakers

Felix Baum

Sr. Dir of Product Management, Qualcomm

Felix Baum has an extensive background of over two decades in the embedded industry, where he has excelled both as an embedded developer and a product manager. Currently he is responsible for AI Software Products at Qualcomm. Prior to that, he led efforts for various real-time operating... Read More →

Wednesday September 18, 2024 2:25pm - 2:50pm PDT
Room B

Breakout Sessions

Audience Intermediate

PyTorch Conference 2024

Felix Baum

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!