AI Inference & Serving
Prefill Phase
The inference stage that processes an input token sequence before autoregressive continuation. It is distinct from assistant-response prefilling, where a caller supplies the beginning of an answer.
Reviewed
Sources
Member lesson
The definition and sources are public. The complete practical lesson is for members.