Deduplication

Removing records judged to represent the same content or entity. Aggressive rules can collapse distinct versions; weak rules leave repeated evidence that falsely appears independent.

Retrieval engineering

How pages become chunks, vectors and candidates inside an answer engine, and why being retrieved is not being cited.

Corpus · Document ingestion · Data connector · Parsing · OCR · Layout-aware parsing · Semantic chunking · Fixed-size chunking · Chunk overlap · Parent-child retrieval · Metadata filtering · Vector database · Vector index · Sparse vector · Dense vector · Cosine similarity · Dot-product similarity · Approximate nearest neighbor · HNSW · Top-k · Retrieval recall · Retrieval precision · Mean reciprocal rank · Normalized discounted cumulative gain · Relevance score · Candidate generation · Query rewriting · Query expansion · HyDE · Multi-query retrieval · Reciprocal rank fusion · Late interaction · Lexical retrieval · Semantic search · Exact-match retrieval · Freshness boosting · Authority weighting · Source diversity · Near-duplicate detection · Semantic cache · Retrieval latency · Retrieval cutoff · Citation mapping · Answer synthesis

← Source diversity · Near-duplicate detection →

See it in the full glossary · 579 terms across 19 areas. Scan a site to see which of these apply to it.