Montage Technology's next-gen MRDIMM hits 12,800MT/s — double today's DDR5

Memory bandwidth has become the silent bottleneck in AI inference. As CPUs pack more cores, the data pipes feeding them struggle to keep pace. Montage Technology thinks it has a workable answer: its second-generation MRDIMM modules, now entering mass trials, push data at 12,800MT/s — roughly double what mainstream server RDIMMs deliver today.

MRDIMM — short for Multiplexed Rank Dual Inline Memory Module — is a JEDEC-standard architecture designed specifically for servers running AI and high-performance computing workloads. Traditional DIMMs hit signal-integrity and speed walls as clock rates climb. MRDIMM gets around this by combining a Multiplexed Ranks Combiner Device (MRCD) with a Multiplexed Data Buffer (MDB), letting a single module support much higher transfer rates than conventional DDR5 memory.

Montage disclosed the progress in an investor relations filing on July 3. The company’s second-generation MRDIMM runs at 12,800MT/s, a 45% jump over the first generation (8,800MT/s) and exactly twice the speed of today’s mainstream third-generation RDIMMs, which top out at 6,400MT/s. A third generation is already on the roadmap, targeting 16,000MT/s.

The timing matters. AI inference workloads — especially large language models running on CPU-based serving infrastructure — are notoriously bandwidth-hungry. When memory bandwidth can’t keep up, expensive compute cycles go to waste waiting on data. MRDIMM directly targets that mismatch.

Industry adoption is still in its early stages. Montage described the current phase as “mass trial” for the second-generation product, with volume deployment expected to begin in the next two to three years. On the CPU side, support is gradually falling into place: more server platforms are expected to add second-generation MRDIMM support between the second half of 2026 and 2027. Broad CPU compatibility is the prerequisite for data-center-scale deployment, and the ecosystem is rounding into shape.

JEDEC, the industry body behind DDR and DIMM standards, formalized several DDR5 MRDIMM specification updates in late April, responding directly to the bandwidth demands of AI and cloud computing. Those standards updates give module makers and CPU designers a fixed target to build toward, which tends to accelerate adoption.

Montage Technology, a Shanghai-based fabless chip company listed on the STAR Market, is one of the few firms currently shipping MRDIMM products. The company’s memory interface chips — including the MRCD and MDB used in MRDIMM modules — are its core revenue driver.