Archives

Rambus significantly improves AI performance with 9.6 Gbps HBM3 memory controller IP

Rambus

As an industry-leading supplier of chips and IP cores dedicated to making data transmission faster and more secure, Rambus Inc. announced that Rambus HBM3 memory controller IP now provides performance up to 9.6 Gbps to support the continued evolution of the HBM3 standard. Compared with the data rate of HBM3 Gen1 6.4 Gbps, the data rate of Rambus HBM3 memory controller is increased by 50%, with a total memory throughput of more than 1.2 TB/s, suitable for recommendation system training, generative AI and other demanding data centers workload.

Neeraj Paliwal, General Manager of Rambus IP Core Division, said: ” Large language models require continuous advancements in high-performance memory technology, making HBM3 the memory of choice for AI/ML training. Relying on Rambus’ innovation and engineering excellence, our HBM3 memory controller IP delivers industry-leading 9.6 Gbps performance.”

Soo-Kyoum Kim, vice president of memory semiconductors at IDC, said: ” HBM is a key memory technology for faster and more efficient processing of large AI training and inference sets, such as those used for generative AI. For HBM IP like Rambus It is of great significance for vendors to continue to improve performance to support leading AI accelerators that meet the market’s demanding requirements.”

Also Read: Quantum Computing Inc. and European-Based Assured Cyber Protection Ltd Enter into Sales and Teaming Agreement 

HBM adopts an innovative 2.5D/3D architecture to provide solutions with high memory bandwidth and low power consumption for AI accelerators. With extremely low latency and compact packaging, HBM has become the first choice for AI training hardware.

Rambus HBM3 memory controller IP is designed for applications requiring high memory throughput, low latency and full programmability. The controller is a highly configurable modular solution that can be customized to each customer’s unique requirements for size and performance. For customers who choose third-party HBM3 PHY, Rambus also provides HBM3 controller integration and verification services.+

Rambus is an industry-leading provider of chip and semiconductor IP that makes data transmission faster and more secure. With more than 30 years of advanced semiconductor R&D experience, we have become a pioneer in high-performance memory solutions, dedicated to solving the bottleneck between memory and data processing for data-intensive systems. Whether in the cloud, at the edge, or on a connected device in your hand, these real-time and immersive applications rely on data throughput and integrity. Rambus’ products and innovations deliver greater bandwidth and capacity and enhanced security to meet the world’s data needs and drive unprecedented user experiences.

SOURCE: Businesswire