Infrastructure
Prompt Caching
Reusing supported computation for repeated prompt content, commonly an unchanged leading prefix, instead of processing all of it afresh. This is not a saved final answer or a substitute for current evidence. Eligibility, accounting and retention depend on the model and provider.
Also called: Context Caching
Reviewed
Sources
Member lesson
The definition and sources are public. The complete practical lesson is for members.