AI Inference & Serving
Speculation Acceptance Rate
The accepted proposed-token count divided by the proposed-token count under an explicitly defined accounting rule. Bonus target tokens and accepted-prefix lengths must not be confused with that denominator.
Also called: Draft Token Acceptance Rate
Reviewed
Sources
Member lesson
The definition and sources are public. The complete practical lesson is for members.