From rendering graphics to processing neural networks, learn how smartphone processors evolved.
If you read our Google Pixel 8 review, you’d have realised how far the applications of artificial intelligence (AI) have come over the years. From computational photography to on-device language models, AI is now essentially used in most of the applications on your smartphone – if it’s not powering them entirely.
But AI is quite costly in terms of computational resources since it requires performing scores of computations simultaneously. And this isn’t something CPUs are best suited for. That’s why the industry has turned to GPUs – and more recently, NPUs. Below we take a look at the role GPUs play in AI and machine learning, particularly in smartphones, and how they’re slowly passing the baton to NPUs.
GPUs as AI processors
Before AI went mainstream, GPUs were designed to rapidly manipulate and alter memory to display images and animate graphics on a smartphone screen. Then when AI applications grew more common, GPUs found a new purpose – they could apply their simultaneous processing ability to run the complex mathematical models needed for AI.
Whether it was facial recognition, object detection in photography, or speech recognition in voice assistants, GPUs powered the latest AI capabilities in smartphones to an extent. Of course, they didn’t fully replace the role of the CPU in these functions, but together they reduced processing times significantly.
The need for specialised AI hardware
However, GPUs had their limits when it came to AI performance. As neural networks and other machine learning models grew even larger and more complex, GPUs couldn’t keep up. Sure, they performed well running mathematical calculations in parallel, but they still weren’t designed exclusively with AI in mind.
And as networks ballooned in size, naive GPU parallelism hurt performance. Add the constraints of power consumption in smartphones, and it was clear specialised hardware would be needed.
Enter the NPU
Dedicated AI hardware was necessary to advance beyond the GPU. The solution that emerged was the Neural Processing Unit or NPU – a microprocessor developed specifically for neural network machine learning. In a nutshell, an NPU’s speciality is crunching numbers for machine learning models.
In terms of design, the NPU is developed with a “data-driven parallel computing” architecture, which is particularly good at processing massive multimedia data such as video and images. It simulates human neurons and synapses at the circuit level and directly processes them with a deep-learning instruction set. This allows the NPU to complete the processing of a group of neurons with one instruction, making it highly efficient for AI computations.
While the main processor could technically run these too, it would consume a lot of power and choke up resources for other apps. Meanwhile, the NPU breezes through these complex calculations using ultra-efficient circuitry assisted by dedicated memory. It generates lightning-fast results for AI apps, freeing up the main chip to hum along smoothly. And by offloading the AI-related heavy lifting, it also saves battery life. Because of these obvious advantages, NPUs are growing more common, particularly in smartphones. They are already used in TPU by Google and the Neural Engine developed by Apple.
is closer to the GPU in that both are designed for parallel processing. It’s just that NPUs are more specialised, focusing solely on neural network tasks, whereas GPUs are more versatile and can handle a wider range of parallel computing tasks.
In terms of core count, the exact number can vary greatly depending on the specific model and manufacturer. However, the general trend is that CPUs have fewer, more powerful cores, GPUs have many cores optimised for parallel tasks (often in thousands), and NPUs have cores specialised for AI computations.
NPU adoption in smartphones
Following their debut a few years ago, NPU silicon has rapidly improved and been integrated into smartphones by nearly all major vendors.
Source:indianexpress.com