Semantic cache
Reusing an earlier result when a new request is judged meaningfully similar.
What Semantic cache means
It reduces latency but can serve stale or inapplicable answers to superficially related questions.
Related terms in Retrieval engineering
How pages become chunks, vectors and candidates inside an answer engine, and why being retrieved is not being cited.
Corpus · Document ingestion · Data connector · Parsing · OCR · Layout-aware parsing · Semantic chunking · Fixed-size chunking · Chunk overlap · Parent-child retrieval · Metadata filtering · Vector database · Vector index · Sparse vector · Dense vector · Cosine similarity · Dot-product similarity · Approximate nearest neighbor · HNSW · Top-k · Retrieval recall · Retrieval precision · Mean reciprocal rank · Normalized discounted cumulative gain · Relevance score · Candidate generation · Query rewriting · Query expansion · HyDE · Multi-query retrieval · Reciprocal rank fusion · Late interaction · Lexical retrieval · Semantic search · Exact-match retrieval · Freshness boosting · Authority weighting · Source diversity · Deduplication · Near-duplicate detection · Retrieval latency · Retrieval cutoff · Citation mapping · Answer synthesis
Questions about Semantic cache
What is Semantic cache?
Reusing an earlier result when a new request is judged meaningfully similar.
Which area of the glossary does Semantic cache belong to?
Retrieval engineering: How pages become chunks, vectors and candidates inside an answer engine, and why being retrieved is not being cited.
← Near-duplicate detection · Retrieval latency →
See it in the full glossary · 772 terms across 19 areas.
Free browser extension
See this on any site you visit, in one click.
CrawlCheck for Chrome grades every site you visit A–F and shows, from your own browser, what search engines and AI assistants are actually served. Free, no account.