If you're in the market for a new laptop and notice that the Dell Pro Max 16 Plus boasts more TOPS than usual, it's because Dell is equipping its latest models with a discrete Neural Processing Unit (NPU) from Qualcomm. The Dell Pro Max 16 Plus features a Qualcomm AI-100 Ultra NPU, delivering 870 INT8 TOPS within a 150 W TDP envelope, along with 128 GB of LPDDR5X memory. This provides enough computing power and memory capacity to run local AI models with up to 120 billion parameters on the NPU alone, without needing additional memory or computing resources.

Dell is outfitting these laptops with robust internals, including up to an Intel Core Ultra 9 285HX vPro CPU with 24 cores. Notably, Dell has removed the discrete GPU to accommodate the NPU, which offers more computing power and VRAM capacity than a traditional GPU. For local AI development, the system utilizes this NPU for all necessary tasks, paired with a CPU and 64 GB of memory. For graphics output, the system relies on the integrated GPU within the "Arrow Lake-HX" chip, which handles basic graphics tasks but isn't suitable for gaming. This design choice is logical, as the dedicated NPU is intended for AI developers and occupies the space, power, and heat dissipation capacity that a GPU would typically use.

Read full story

More...