This tiny box from Samsung can hold 2TB of a special kind of RAM worth tens of thousands of dollars — CXL Memory Module Box hailed as the future of expansive server memory in the age of AI

This tiny box from Samsung can hold 2TB of a special kind of RAM worth tens of thousands of dollars — CXL Memory Module Box hailed as the future of expansive server memory in the age of AI
Pls share this post


Listen to this article

At MemCon 2024, Samsung showcased its latest HBM3E technology, talked about its future HBM4 plans, and unveiled the CXL Memory Module Box, also known as CMM-B, the latest addition to its Compute Express Link (CXL) memory module portfolio.

CMM-B is essentially a memory pooling appliance for rack computing leveraging CXL. It supports disaggregated memory allocation, allowing memory capacity available in remote locations to be shared across multiple servers. Through this, CMM-B enables independent resource allocation in the rack cluster and allows for larger pools of memory to be assigned as needed. With up to 60GB/s bandwidth, Samsung says CMM-B is ideal for applications like AI, in-memory databases, and data analytics.

READ ALSO  Windows 11 Enterprise enhancements are here - and the AI enhanced Windows Autopatch is a gamechanger

CMM-B can accommodate eight E3.S form factor CMM-D (PCIe Gen5) memory modules for a total of 2TB. CMM-D memory integrates Samsung’s DRAM technology with the CXL open standard interface to deliver efficient, low-latency connectivity between the CPU and memory expansion devices.

Easy setup

Samsung says the CMM-B integrates seamlessly into Supermicro Plug and Play Rack Scale Solutions, ensuring not only faster productivity but also reduced total cost of ownership (TCO).

The CMM-B module comes pre-installed with Samsung’s Cognos Management Console (SCMC) software, which provides an intuitive interface for quick setup of the Rack-Scale server appliance. This software facilitates dynamic memory allocation, enabling memory to be allocated independently of the server to which it is attached.

READ ALSO  Google restricts Gemini AI in answering election-based questions

During his keynote at MemCon, Jin-Hyeok Choi, Corporate Executive Vice President, Device Solutions Research America – Memory at Samsung Electronics said, “AI innovation cannot continue without memory technology innovation. As the market leader in memory, Samsung is proud to continue advancing innovation – from the industry’s most advanced CMM-B technology, to powerful memory solutions like HBM3E for high-performance computing and demanding AI applications. We are committed to collaborating with our partners and serving our customers to unlock the full potential of the AI era together.”

SuperMicro CMM-B

(Image credit: Samsung)

More from TechRadar Pro

READ ALSO  Adobe releases AI assistant that can summarize all those complex PDFs for you

Source



Pls share this post
Previous articleThe rumored Apple Pencil 3 could make it easier than ever to draw on iPads
Next articleTrump Media investors accused of insider trading plead guilty to fraud