63% of AI chip costs go to memory, ushering in an era where memory is more expensive than GPUs

TL;DR AI
2 min readKey summary
Epoch AI says memory now accounts for 63% of AI chip component costs, up from 52% in Q1 2024.
HBM has become a bigger cost driver as demand and prices rise for advanced AI chips.
The shift suggests AI hardware economics are moving from compute toward memory.
That could lift infrastructure costs and affect capex plans at major cloud and tech companies.



