Skip to content
0MESubscribe

memory bandwidth

The maximum rate at which data moves between a processor and its system memory.

Bandwidth is typically measured in gigabytes per second and acts as a throughput ceiling for computer systems. High memory bandwidth is crucial for training and running large AI models because they require rapid transfer of large sets of parameters.

Stories using this word