Concepts
Tokens
The basic building blocks of language that an AI processes. A token is roughly equivalent to 3/4ths of a word.
This entry has not yet received a source-reviewed lesson update.
Free complete lesson
This definition and the complete practical lesson are free. The interactive reader loads the lesson examples without a membership.