Llms On Amd Ryzen Ai Pcs

This is the first video in the AMD Ryzen TM developer series, focusing on how Ryzen AI 300 series PCs use both NPUs and integrated GPUs to accelerate large language model workloads. We briefly explain the Hybrid LLM flow, which partitions tasks between the NPU and GPU to optimize performance and efficiency. The video also covers AMD Ryzen AI software, which helps developers optimize AI workloads and deploy models using tools like PyTorch, ONNX, and Quark. . . Links Referenced in the Video: . 5:12 https://www.amd.com/en/developer/resources/ryzen-ai-software.html . . Additional Resources: . Quark Documentation – https://quark.docs.amd.com/latest/ . Ryzen AI Documentation – https://ryzenai.docs.amd.com/en/latest/index.html . Lemonade SDK – https://github.com/onnx/turnkeyml/blob/main/docs/lemonade/README.md. Up Next: . Running LLMs on AMD Ryzen AI PCs Using the Lemonade SDK. https://youtu.be/Ys7n5OouwtI. . Find the resources you need to develop using AMD products: https://www.amd.com/en/developer.html . . ***. . © 2025 Advanced Micro Devices, Inc. All rights reserved. AMD, the AMD Arrow logo, EPYC, ROCm, and AMD Instinct and combinations thereof are trademarks of Advanced Micro Devices, Inc.. . 49QQL7EJBEGHWOB4