AI Knowledge HubHardware & Performance
HBM
The special memory AI compute uses to run fast.
High-bandwidth memory moves data far faster than ordinary RAM. AI compute repeatedly shuttles data from memory to the processor, and that hop is the bottleneck. Wider bandwidth keeps the processor busy instead of waiting.
Why it mattersThat 'out of video memory' error often comes down to bandwidth rather than capacity. Knowing HBM is what stops you from reading a spec sheet and picking on capacity alone.
ExampleThe flat chip sitting beside a GPU is HBM.