AI Inference & Serving
Draft Model
A model used to propose continuations for a target model to verify in speculative generation. It has a different role from the model whose accepted output distribution is being preserved.
Reviewed
Sources
Member lesson
The definition and sources are public. The complete practical lesson is for members.