AI Memory Costs Are Exploding — and the Worst Is Yet to Come

The cost of memory chips used for artificial intelligence is rising fast, and experts warn the surge is far from over. Prices for high-bandwidth memory (HBM) — a specialized type of chip that AI systems need to process data quickly — have climbed sharply in recent months. Demand from AI data centers is the main driver, as companies race to build and expand the infrastructure that powers tools like chatbots and image generators. Supply cannot keep up. Making HBM is complex and expensive, and manufacturers need years to build new production lines. That gap between rising demand and limited supply is pushing prices higher. Analysts expect the situation to worsen before it improves. New factories will not open soon enough to ease the shortage, meaning AI companies will likely pay even more for memory in the coming months. The trend matters beyond the tech industry. Higher memory costs could raise the price of AI services and slow the pace of new AI development worldwide.