AI Inference & Serving
Memory-Bandwidth Bound
A workload whose achievable processing rate is constrained primarily by moving data through memory rather than arithmetic capacity. The bottleneck depends on the operation, hardware and workload.
Also called: Bandwidth-Limited Computation
Reviewed
Sources
Member lesson
The definition and sources are public. The complete practical lesson is for members.