William Blair：2026年解决扩展AI内存的能源成本问题报告（英文版）

Bandwidth the Key AI Memory Bottleneck AI performance is increasingly limited by memory bandwidth, since large language models (LLMs) require moving enormous volumes of data for relatively little computation.. Training and inference involve repeatedly streaming massive amounts of data—e.g., model parameters, context, and KV cache—through accelerators with relatively low data reuse. As a result, performance is often lim- ited by how fast data can be delivered rather than how many compute fl