Memory scarcity, not GPU allocation, is now driving data center cost inflation

Data center capital expenditures rose 92% year-over-year in the second quarter of 2026, and for the first time this cycle, memory and storage pricing did as much to drive that growth as GPU deployment itself, according to Dell'Oro Group. Server average selling prices climbed as memory costs pushed baseline hardware costs higher across the board, with neocloud and AI model-builder customers posting the fastest capex growth even as established hyperscalers roughly doubled their own spending.

The pricing pressure traces to a memory market that manufacturers themselves describe as effectively sold out. Samsung Electronics president Wonjin Lee warned this month that 2026 semiconductor supply constraints would extend industry-wide, while SK Hynix has separately confirmed its HBM, DRAM, and NAND capacity is essentially committed for the year. Samsung raised its 32GB DDR5 module price to $239 from $149 within a single month; contract DDR5 pricing has more than doubled year-over-year; Gartner projects a 47% DRAM price increase for 2026 overall.

"In 2026, there's going to be issues around semiconductor supplies, and it's going to affect everyone, not just Samsung." — Wonjin Lee, president, Samsung Electronics

Read together, the two data points describe the same shift from different vantage points: as manufacturers redirect fab capacity toward higher-margin HBM for AI accelerators, conventional DRAM supply has tightened enough to inflate the cost of ordinary servers, not just AI-optimized ones. That reframes the exposure facing supply-chain vendors — allocation risk is no longer confined to accelerators from a handful of chip suppliers but now runs through commodity memory in every server order. Mid-market buyers without hyperscaler-scale long-term supply agreements are the most exposed, and with major new capacity such as Samsung's Pyeongtaek fab not reaching mass production until 2028, the constraint looks structural rather than a single-quarter spike. Market-research firm TrendForce projects server DRAM contract prices will climb a further 13-18% quarter-over-quarter in the third quarter alone, with total RDIMM bit supply growing only 15-20% year over year against much faster server CPU shipment growth — the structural shortfall behind the price run, which TrendForce expects to persist into 2027 rather than ease by the end of 2026.