CEVA, Inc, the leading licensor of wireless connectivity, smart sensing technologies and custom SoC solutions, announced its enhanced NeuPro-M NPU family, directly addressing the processing needs of the next era of Generative AI with industry-leading performance and power efficiency for any AI inferencing workload, from cloud to the edge. The NeuPro-M NPU architecture and tools have been extensively redesigned to support transformer networks in addition to CNNs and other neural networks, as well as support for future machine learning inferencing models. This enables highly-optimized applications leveraging the capabilities of Generative and classic AI to be seamlessly developed and run on the NeuPro-M NPU inside communication gateways, optically connected networks, cars, notebooks and tablets, AR/VR headsets, smartphones, and any other cloud or edge use case.
Ran Snir, Vice President and General Manager of the Vision Business Unit at CEVA, commented: “Transformer-based networks that drive Generative AI require a massive increase in compute and memory resources, which calls for new approaches and optimized processing architectures to meet this compute and memory demand boost. Our NeuPro-M NPU IP is designed specifically to handle both classic AI and Generative AI workloads efficiently and cost-effectively today and in the future. It is scalable to address use cases from the edge to the cloud and is future proof to support new inferencing models. The leap in performance we have achieved with this architecture brings the incredible promise of Generative AI to any use case, from cost-sensitive edge devices all the way up to highly-efficient cloud computing and everything in between.”
ABI Research forecasts that Edge AI shipments will grow from 2.4 billion units 2023 to 6.5 billion units in 2028, at a common annual growth rate (CAGR) of 22.4%*. Generative AI is set to play a vital role in underpinning this growth, and increasingly sophisticated and intelligent edge applications are driving the need for more powerful and efficient AI inferencing techniques. In particular, the Large Language Models (LLMs) and vision and audio transformers used in generative AI can transform products and industries but introduce new levels of challenges in terms of performance, power, cost, latency and memory when running on edge devices.
Reece Hayden, Senior Analyst, ABI Research, stated: “The hardware market for Generative AI today is heavily concentrated with dominance by a few vendors. In order to deliver on the promise of this technology, there needs to be a clear path to lower power, lower cost inference processing, both in the cloud and at the edge. This will be achieved with smaller model sizes and more efficient hardware to run it. CEVA‘s NeuPro-M NPU IP offers a compelling proposition for deploying generative AI on-device with an impressive power budget, while its scalability also allows NeuPro-M to address more performance-intense use cases in network equipment and beyond.”
SOURCE: PRNewswire