Infrastructure
Max Tokens
Max tokens is a setting on a request sent by software that caps how long the reply is allowed to be. If the answer would run past that cap, it simply stops part way through. It limits the reply only, not the length of what you send in.
This entry has not yet received a source-reviewed lesson update.
Member lesson
The definition and sources are public. The complete practical lesson is for members.