Agent Engineering

Semantic Cache

A cache that can reuse stored responses for semantically similar requests rather than requiring identical request text. This differs from reusing model prefix computation through prompt caching. Similarity alone does not establish equivalent intent, current facts or authorization to see the cached answer.

Reviewed

Sources

Member lesson

The definition and sources are public. The complete practical lesson is for members.

Compare membership plans ยท Already a member? Sign in

Explore all dictionary definitions