AMD's first generation XDNA-based Neural Processing Unit (NPU) arrived last year, as an onboard aspect of their "Phoenix" Ryzen 7040 mobile processor series, followed many months later by Intel's similarly NPU-laden Core Ultra "Meteor Lake" generation. It was recently revealed that a Windows 11 DirectML preview grants preliminary support for Core Ultra NPUs—Microsoft's software engineering department seems to be prioritizing Intel AI tech. Team Red has already released XDNA on desktop platforms—with its Ryzen 8000G APU family—and the "Hawk Point" 8040 series is nearing a retail launch, but these processors (plus 7040) remain unsupported by Microsoft's DirectML API. An interesting AMD community blog entry was posted two weeks—news outlets have been slow to pick up on its relevance.

Intel NPU activity can be monitored in Windows Task Manager (see screenshot below), and an upcoming update will add competing AMD parts to the mix. Joel Hruska's Team Red community blog post reveals that NPU monitoring for Ryzen 8040 series processors is due soon: " As AI PCs become more popular, there's a growing need for system monitoring tools that can track the performance of the new NPUs (Neural Processing Units) available on select Ryzen 8040 Series mobile processors. A neural processing unit - also sometimes referred to an integrated or on-die AI engine -- can improve battery life by offloading AI tasks that would otherwise be performed on the CPU or GPU. AMD has been working with Microsoft to enable MCDM (Microsoft Compute Driver Model) infrastructure on the AMD NPU (Neural Processing Unit)-enabled Ryzen 8040 Series of mobile processors. MCDM is a derivative of Windows Display Driver Model (WDDM) that is targeting non-GPU, compute devices, such as the NPU. MCDM enables NPUs to make use of the existing GPU device management infrastructure, including scheduling, power management, memory management, and performance debugging with tools such as the Task Manager. MCDM serves as a fundamental layer, ensuring the smooth execution of AI workloads on NPU devices."

Read full story

More...