AI Inference & Serving
Pipeline Parallelism
Placing successive stages, often groups of model layers, on different devices. Work passes through those stages; multiple work items can overlap after the pipeline begins filling.
Also called: PP
Reviewed
Sources
Member lesson
The definition and sources are public. The complete practical lesson is for members.