News [Phoronix] AMD Ryzen AI NPUs Are Finally Useful Under Linux For Running LLMs

News

LinuxBot

Member
Joined
Apr 25, 2017
Messages
5,739
Reaction score
74
Credits
-1,257
Over the past two years AMD has developed the AMDXDNA accelerator driver in the mainline Linux kernel for supporting the AMD Ryzen AI NPUs. But when it comes to user-space software on Linux actually able to leave the Ryzen AI NPUs it's been... extremely limited with nothing really useful besides some niche bits of code. Even AMD's own software like their GAIA on Linux has used Vulkan with their iGPUs rather than any NPU support. But finally today there is a significant shift with the Ryzen AI NPUs becoming useful on Linux and able to handle LLMs...

Source: https://www.phoronix.com/news/AMD-Ryzen-AI-NPUs-Linux-LLMs

Aggregated via Linux News
 


Follow Linux.org

Members online


Top