Concepts
Top-P / Top-K
Two ways to restrict candidate tokens during generation: top-k retains a specified number of leading candidates, while top-p retains a set reaching a cumulative probability threshold. Top-p is not a percentage of vocabulary items. Tie handling, filter ordering and other sampling settings require an explicit implementation convention.
Reviewed
Sources
Member lesson
The definition and sources are public. The complete practical lesson is for members.