Concepts

Context Window

The bounded amount of input and generated output a model can handle within a request, usually measured in tokens. Instructions, conversation history, tool definitions and results may consume that capacity. Exact accounting and overflow handling depend on the model and application. Fitting information inside the window does not guarantee accurate recall or reasoning.

Reviewed

Sources

Free complete lesson

This definition and the complete practical lesson are free. The interactive reader loads the lesson examples without a membership.

Find the free complete lesson

Explore all dictionary definitions