AI Inference & Serving
Decode Phase
The inference stage that extends an output based on the input and tokens already generated. In ordinary autoregressive generation, each next-token decision depends on the preceding sequence.
Reviewed
Sources
Member lesson
The definition and sources are public. The complete practical lesson is for members.